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(54) OPTICAL DISC FOR HIGH RESOLUTION AND THREE-DIMENSIONAL IMAGE RECORDING, 
OPTICAL DISC REPRODUCING DEVICE, AND OPTICAL DISC RECORDING DEVICE 



(57) In an optical disc on which image signals of 
high resolution are recorded and a system for reproduc- 
ing thereof, compatibility with a conventional system for 
reproducing image signals of normal resolution is to be 
realized. Image signals of high resolution are divided 
into a main signal and an auxiliary signal by an image 
separating member, and a first interleave block (54) and 
a second interleave block (55) formed by dividing each 
MPEG-coded stream into groups of frames of one GOP 
or more are alternately recorded on an optical disc (1). 
In a reproducing device capable of handling high resolu- 
tion, both the first and the second interleave blocks are 
reproduced, thus providing an image of high resolution. 
On the other hand, in a reproducing device incapable of 
handling high resolution, only one of the first and the 
second interleave blocks is reproduced, thus providing 
an image of normal resolution. 
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Description 
TECHNICAL FIELD 

[0001 ] The present invention relates to an optical disk 
having a three-dimensional (3D) picture and a high def- 
inition picture stored thereon, and an apparatus for 
recording data to or reproducing data from the optical 
disk. 

BACKGROUND ART 

[0002] A conventionally known optical disk having a 
3D moving picture stored thereon is as shown in Figure 
10. An optical disk 201 has a picture for the right eye 
(right-eye picture) stored in even fields 204, 204a and 
204b and a picture for the left eye (left-eye picture) 
stored in odd fields 203, 203a and 203b. The right-eye 
picture and the left-eye picture are recorded alternately. 
When the data stored on the optical disk 201 is repro- 
duced by an existing optical disk reproduction appara- 
tus 205 shown in Figure 1 1 , a right-eye picture and a 
left-eye picture appear on a TV screen 206 alternately 
every 1/60 second. The naked eye recognizes only a 
picture in which the right-eye picture and the left-eye 
picture are overlapped. With 3D spectacles 207, in 
which a shutter for the right- eye picture and a shutter for 
the left-eye picture are switched over every 1/60 sec- 
ond, a 3D picture is recognized. As shown in Figure 12, 
a right-eye picture and a left-eye picture are each 
encoded alternately in every other field as an interlace 
signal in 1 GOP of an MPEG signal. 
[0003] For high definition pictures, progressive sys- 
tems referred to as 525P and 720P have been studied. 
[0004] A first problem of the conventional art will be 
described. When data in a conventional 3D optical disk 
is reproduced by an ordinary, conventional 2D repro- 
duction apparatus, even a non-3 D picture, i.e., even a 
2D picture is not output. Data in the 3D optical disk is 
only reproduced by a reproduction apparatus con- 
nected to a 3D display. Accordingly, it is required to cre- 
ate two types of optical disks, i.e., a 3D optical disk and 
a 2D optical disk for the same contents . The same is 
true with the high definition picture. In other words, the 
conventional 3D and high definition optical disks are not 
compatible with ordinary optical disks. A first objective 
of the present invention is to provide a 3D or high defini- 
tion optical disk which is compatible with ordinary opti- 
cal disks, and a reproduction system for the 3D or high 
definition optical disk. 

[0005] The term "compatibility" is clearly defined as 
similar to the compatibility between monaural records 
and stereo records discussed in the past. In other 
words, data in a novel 3D or high resolution disk accord- 
ing to the present invention is output as a "monaural" 
vision, i.e., as a 2D picture or an ordinary resolution pic- 
ture by an existing reproduction apparatus developed 
for DVDs or the like, and is reproduced as a "stereo" 



vision, i.e., a 3D picture or a high resolution picture by 
the novel reproduction apparatus according to the 
present invention. 

[0006] A second problem of the conventional art con- 
5 cerns a synchronization system. According to a conven- 
tional synchronization system, decoding starts when 
decoding conditions for each compressed video signal 
are provided. The conventional synchronization system 
has problems in that, for example, when the data 
10 becomes out of synchronization for some reason during 
reproduction, compensation is not performed; and that 
audio data is not synchronized. 
[0007] A second objective of the present invention is 
to provide a reproduction apparatus for reproducing a 
is plurality of compressed video signals or a plurality of 
compressed audio signals in synchronization with one 
another and performing compensation when the data 
becomes out of synchronization during reproduction. 

20 DISCLOSURE OF INVENTION 

[0008] The present invention includes the following 
means to achieve the above-described objectives. 
[0009] An optical disk according to the present inven- 

25 tion is obtained in the following manner. Two moving pic- 
tures each having a frame rate of 30 frames/sec. are 
input. A plurality of frames of each picture, which corre- 
spond to 1 GOP or more of the disk, are set as a picture 
unit. These picture units of the two pictures are 

30 arranged on the optical disk alternately as interleave 
blocks. Each interleave block corresponds to one rota- 
tion or more. The two moving pictures can be, for exam- 
ple, a picture for the right eye and a picture for the left 
eye; or includes field components of a progressive pic- 

35 ture. 

[001 0] When such an optical disk is reproduced by an 
ordinary reproduction apparatus for two-dimensional 
(2D) display, an ordinary two-dimensional is repro- 
duced. 

40 [001 1 ] A reproduction apparatus for 3D and high def- 
inition pictures according to the present invention 
includes means for reproducing picture identification 
information from an optical disk, means for reproducing 
a two-dimensional picture in a conventional process, 

45 means for reproducing a 3D or high definition picture, 
and means for outputting the 3D or high definition pic- 
ture. 

[0012] The present invention includes the following 
means to achieve the second objective. 

so [0013] A reproduction apparatus according to the 
present invention includes reference time signal gener- 
ation means for generating a reference time signal; and 
a plurality of picture extension/reproduction means hav- 
ing a function of extending a compression video stream 

55 and controlling reproduction time of the extended video 
signal in accordance with the difference between the 
reference time signal and the picture reproduction time 
information. 
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[0014] Another reproduction apparatus according to 
the present invention includes a plurality of picture 
extension/reproduction means having a function of gen- 
erating a reference time signal, extending a compres- 
sion video stream and controlling reproduction time of 
the extended video signal in accordance with the differ- 
ence between the reference time signal and the picture 
reproduction time information. The reference time sig- 
nals in the plurality of picture extension/reproduction 
means are corrected using identical information at sub- 
stantially the same time. 

[001 5] Still another reproduction apparatus according 
to the present invention includes reference time signal 
generation means for generating a reference time sig- 
nal; and a plurality of audio extension/reproduction 
means having a function of extending a compression 
audio stream and controlling reproduction time of the 
extended audio signal in accordance with the difference 
between the reference time signal and the audio repro- 
duction time information. 

[0016] Yet another reproduction apparatus according 
to the present invention controls reproduction time by 
changing the frequency of the clock by which the audio 
extension/reproduction means performs extension and 
reproduction. 

BRIEF DESCRIPTION OF DRAWINGS 
[0017] 

Figure 1 is a block diagram showing a recording 
apparatus in one example according to the present 
invention. 

Figure 2 is a timing diagram showing the relation- 
ship between an input signal and a recording signal 
in one example according to the present invention. 

Figure 3 is a top view of an optical disk showing the 
interleave block arrangement in one example 
according to the present invention. 

Figure 4 is a view illustrating 3D picture arrange- 
ment information one example according to the 
present invention. 

Figure 5 is a view showing a reproduction appara- 
tus in one example according to the present inven- 
tion. 

Figure 6 is a timing diagram illustrating the relation- 
ship between a recorded signal and a picture output 
signal in a reproduction apparatus in one example 
according to the present invention. 

Figure 7 is a block diagram showing an MPEG 
decoder of a different system of a reproduction 
apparatus in one example according to the present 



invention. 

Figure 8 is a timing diagram showing the relation- 
ship between a recording signal and an output sig- 
5 nal when 2D reproduction is performed with a 

reproduction apparatus in one example according 
to the present invention. 

Figure 9 is a block diagram showing a 2D reproduc- 
w tion apparatus in one example according to the 
present invention. 

Figure 10 is a top view showing data arrangement 
of a conventional optical disk having a 3D picture. 

15 

Figure 11 is a block diagram showing a reproduc- 
tion apparatus for reproducing a conventional opti- 
cal disk having a 3D picture. 

20 Figure 1 2 is a timing diagram showing the relation- 
ship between a recording signal obtained by repro- 
ducing a conventional optical disk having a 3D 
picture and a picture output signal. 

25 Figure 1 3 is a timing diagram showing the relation- 
ship among a virtual 3D identifier, an R output and 
an L output in one example according to the 
present invention. 

30 Figure 1 4 is a reproduction sequence view showing 
the difference of f pointer accessing in an ordinary 
picture reproduction mode and a 3D reproduction 
mode in one example according to the present 
invention. 

35 

Figure 15 is a flowchart (I) illustrating how a proc- 
ess of accessing a pointer is changed in accord- 
ance with whether a 3D video signal is reproduced 
or not in one example according to the present 
40 invention. 

Figure 16 is a flowchart (II) illustrating how a proc- 
ess of accessing a pointer is changed in accord- 
ance with whether a 3D video signal is reproduced 
45 or not in one example according to the present 
invention. 

Figure 17 is a flowchart showing how the manner of 
output is changed in accordance with whether the 
so signal to be reproduced is a 3D video signal or not 
by a 3D reproduction apparatus in one example 
according to the present invention. 

Figure 18 is a view showing a 3D picture identifier in 
55 a 3D picture logical arrangement table in one exam- 
ple according to the present invention. 

Figure 1 9 is a flowchart showing a method for spec- 
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ifying the attribute of each chapter, cell and inter- 
leave block of a 3D picture based on a 3D picture 
identifier in the 3D picture logical arrangement table 
in one example according to the present invention. 

5 

Figure 20 is a block diagram of a reproduction 
apparatus in an interlace picture signal output 
mode in one example according to the present 
invention. 

10 

Figure 21 is a block diagram of a reproduction 
apparatus in a progressive picture signal output 
mode in one example according to the present 
invention. 

75 

Figure 22 is a block diagram of a recording appara- 
tus in a progressive picture signal input mode in 
one example according to the present invention. 

Figure 23 is a view illustrating the principle of multi- 20 
pie angle video data division multiplex system in 
one example according to the present invention. 

Figure 24 is a block diagram of a reproduction 
apparatus in a 3D picture signal reproduction mode 25 
in one example according to the present invention. 

Figure 25 is a block diagram of a 4X reproduction 
apparatus in a 3D progressive picture signal repro- 
duction mode in one example according to the 30 
present invention. 

Figure 26 is a block diagram of a reproduction 
apparatus in a multi-stream progressive picture sig- 
nal reproduction mode in one example according to 35 
the present invention. 

Figure 27 is a view illustrating a data structure of 
the entire optical disk in one example according to 
the present invention. 40 

Figure 28 is a view illustrating an inner structure of 
a volume information file in Figure 27 in one exam- 
ple according to the present invention. 

45 

Figure 29 is a flowchart showing a detailed process 
for reproducing a program chain group by a system 
control section M1-9 in one example according to 
the present invention. 

50 

Figure 30 is a block diagram showing a structure of 
a part of an AV synchronization control 12-10, the 
part performing AV synchronization, in one exam- 
ple according to the present invention. 

55 

Figure 31 is a timing diagram showing a data 
stream which is reproduced and output through a 
buffer of the decoder in one example according to 



the present invention. 

Figure 32 is a view illustrating a method for reduc- 
ing interlace interference by turning on or off a filter 
in one example according to the present invention. 

Figure 33 is a view illustrating the principle of an 
encoding system using a common motion detecting 
vector in one example according to the present 
invention. 

Figure 34 is a view illustrating a method for adjust- 
ing the timing for reproducing data from a DVD disk 
in one example according to the present invention. 

Figure 35 is a timing diagram showing reproduction 
of an interleave block when one video stream is 
switched to another in one example according to 
the present invention. 

Figure 36 is a view illustrating the principle of 
recording two progressive video signals after divid- 
ing them into interleave blocks in one example 
according to the present invention. 

Figure 37 is a flowchart showing a method for skip- 
ping a first dummy field of a VOB in one example 
according to the present invention. 

Figure 38 is a flowchart illustrating a process of 
STC switching for seamless connection in one 
example according to the present invention. 

Figure 39 is a block diagram of data decoding in 
one example according to the present invention. 

Figure 40 is a view illustrating the principle of divid- 
ing a scope (wide) picture in a horizontal direction 
and recording the resultant signals as interleave 
blocks in one example according to the present 
invention. 

Figure 41 is a view illustrating the principle of syn- 
thesizing a scope (wide) picture from an optical disk 
having the scope picture in a divided State and 
processing the synthesized picture with 3-2 trans- 
form in one example according to the present 
invention. 

Figure 42 is a structural view of a system stream 
and video data on an optical disk in one example 
according to the present invention. 

Figure 43 is a flowchart for seamless connection in 
one example according to the present invention. 

Figure 44 is a view illustrating a method for dividing 
interpolation information in horizontal and vertical 
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directions and recording the resultant signals in 
interleave blocks in one example according to the 
present invention. 

Figure 45 is a timing diagram of reproduction of pro- s 
gressive, 3D and wide signals with respect to the 
data amount in buffer in one example according to 
the present invention. 

Figure 46 is a structural view of a horizontal filter w 
and a vertical filter in one example according to the 
present invention. 

Figure 47 is a block diagram of a reproduction 
apparatus which shares a common motion vector is 
signal and color information in one example accord- 
ing to the present invention. 

Figure 48 is a view illustrating the principle of 
motion detection of a progressive picture using a 20 
motion detection vector in one example according 
to the present invention. 

Figure 49 shows a signal format of a picture identi- 
fier in one example according to the present inven- 25 
tion. 



Figure 57 is a flowchart illustrating a method for 
performing AV synchronization of a first decoder 
and a second decoder in one example according to 
the present invention. 

Figure 58 is a view illustrating the principle of an 
M ADM system for dividing a signal into two in a hor- 
izontal direction in one example according to the 
present invention. 

In Figure 59, (a) is a view illustrating processing of 
an entirety of a horizontal filter circuit in one exam- 
ple according to the present invention, and (b) is a 
view illustrating processing of each line of the hori- 
zontal filter circuit in one example according to the 
present invention. 

Figure 60 is a block diagram of a system for dividing 
a scope-size picture into two in a horizontal direc- 
tion and recording in the MADM system in one 
example according to the present invention. 

Figure 61 is a view illustrating the principle of a pro- 
vider defined stream multiplex system (vertical divi- 
sion) in one example according to the present 
invention. 



Figure 50 shows contents of a vertical filter and a 
horizontal filter in one example according to the 
present invention. 30 

Figure 51 is a view illustrating the principle of divid- 
ing and recording a 1050 interlace signal in one 
example according to the present invention. 

35 

Figure 52 is an arrangement view for outputting a 
progressive signal, an NTSC signal and a HDTV 
signal in one example according to the present 
invention. 

40 

Figure 53 is a view showing a progressive repro- 
duction method for reproducing an interleave block 
while referring to a video presentation time stamp in 
one example according to the present invention. 

45 

Figure 54 is an arrangement view of an HDTV sub 
signal and an NTSC signal by simultaneous casting 
in one example according to the present invention. 



Figure 62 is a view illustrating the principle of a pro- 
vider defined stream multiplex system (horizontal 
division) in one example according to the present 
invention. 

Figure 63 shows a signal format of provider defined 
stream multiplex system in one example according 
to the present invention. 

Figure 64 is a block structural view of an optical disk 
reproduction apparatus in one example according 
to the present invention. 

Figure 65 is a structural view of a video decoder in 
one example according to the present invention. 

Figure 66 shows a data structure of an optical disk 
in one example according to the present invention. 

Figure 67 is a timing diagram of video reproduction 
in one example according to the present invention. 



Figure 55 is a block diagram of a reproduction so 
apparatus for an HDTV/NTSC disk by simultaneous 
casting in one example according to the present 
invention. 

Figure 56 is a flowchart illustrating a method for ss 
controlling two buffers in one example according to 
the present invention. 



Figure 68 is a block structural view of an optical disk 
reproduction apparatus in one example according 
to the present invention. 

Figure 69 is a structural view of an audio decoder in 
one example according to the present invention. 

Figure 70 shows a data structure of an optical disk 
in one example according to the present invention. 
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Figure 71 is a timing diagram of audio and video 
reproduction in one example according to the 
present invention. 

Figure 72 shows an optical disk reproduction appa- s 
ratus in one example according to the present 
invention. 

Figure 73 is a structural view of a video decoder in 
one example according to the present invention. io 

Figure 74 is a timing diagram of video reproduction 
in one example according to the present invention. 

Figure 75 is a block structural view of an optical disk 15 
reproduction apparatus in one example according 
to the present invention. 

Figure 76 is a structural view of a video decoder in 
one example according to the present invention. 20 

Figure 77 is a structural view of a video decoder in 
one example according to the present invention. 

Figure 78 is a structural view of a video decoder in 25 
one example according to the present invention. 

Figure 79 is a block structural view of an optical disk 
reproduction apparatus in one example according 
to the present invention. so 

Figure 80 is a structural view of an audio decoder in 
one example according to the present invention. 

Figure 81 shows a data structure of an optical disk 35 
in one example according to the present invention. 

Figure 82 is a timing diagram of audio and video 
reproduction in one example according to the 
present invention. 40 

Figure 83 is a timing diagram of operation frequen- 
cies of audio and video reproduction in one exam- 
pie according to the present invention. 

45 

Figure 84 is a timing diagram of operation frequen- 
cies of audio and video reproduction in one exam- 
ple according to the present invention. 

Figure 85 is an IP structural view of an MADM so 
stream in one example according to the present 
invention. 

Figure 86 shows a method for preventing a conven- 
tional reproduction apparatus from outputting a sub ss 
picture signal in one example according to the 
present invention. 



Figure 87 shows simulation calculation results 
showing a buffer amount required for simultaneous 
reproduction in one example according to the 
present invention. 

Figure 88 is an arrangement view of continuous 
blocks and interleave blocks in one example 
according to the present invention. 

Figure 89 is an arrangement view of interleave 
blocks in one example according to the present 
invention. 

Figure 90 is a block diagram of multiple (2) screen 
in one example according to the present invention. 

Figure 91 is a view illustrating the principle of divid- 
ing a high resolution video signal in a horizontal 
direction to obtain two streams, recording the 
streams, synthesizing the two streams to reproduce 
the high resolution video signal (luminance signal) 
in the first example according to the present inven- 
tion. 

Figure 92 is a view illustrating the principle of divid- 
ing a high resolution video signal in a horizontal 
direction to obtain two streams, recording the 
streams, synthesizing the two streams to reproduce 
the high resolution video signal (color signal) in the 
first example according to the present invention. 

Figure 93 is a flowchart illustrating the compatibility 
when an MADM disk in the first example according 
to the present invention is reproduced by a conven- 
tional reproduction apparatus. 

Figure 94 is a flowchart illustrating an operation of 
reproducing an MADM disk in the first example 
according to the present invention by an MADM 
reproduction apparatus. 

In Figure 95, (a) is a view illustrating an accessing 
process using a pointer of first reproduction infor- 
mation when an MADM disk in the first example 
according to the present invention is reproduced by 
a conventional reproduction apparatus, and (b) is a 
view illustrating an accessing process using second 
reproduction information when an MADM disk in 
the first example according to the present invention 
is reproduced by an MADM reproduction appara- 
tus. 

Figure 96 is a block diagram of a reproduction 
apparatus for synthesizing two streams in the first 
example according to the present invention. 

Figure 97 is a block diagram of a system for repro- 
ducing two streams obtained by being divided on a 
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frame-by-frame basis and synthesizing the streams 
in a time axis in the first example according to the 
present invention. 

Figure 98 is a block diagram of a recording appara- s 
tus and a reproduction apparatus for dividing a pro- 
gressive video signal into two streams and 
synthesizing the signals into the progressive video 
signal in the first example according to the present 
invention. w 

BEST MODE FOR CARRYING OUT THE INVENTION 

[0018] The best mode of the present invention will be 
described with reference to the figures. is 
[0019] In this specification, a recording and reproduc- 
tion system for simultaneously reproducing a plurality of 
streams according to the present invention will be 
referred to as an "MADM" system. 

[0020] In the first example of the present invention, a 20 
method for recording and reproducing a 3D picture and 
a high definition picture will be first described, and then 
a method for realizing the high definition picture will be 
described, both as applications of the MADM system 
according to the present invention. In the second 25 
through eighth examples, practical methods for syn- 
chronization used for reproducing data according to the 
MADM system will be described. 

(Example 1) 30 

[0021] According to the present invention, a 3D pic- 
ture and a wide screen picture are recorded in the state 
where the picture is divided into two pictures of a right- 
eye picture and a left-eye picture, or divided into two 35 
screen pictures separated from each other along a hor- 
izontal line. These two pictures are field pictures starting 
from an odd line, and a signal representing such a field 
picture is referred to as an Odd First signal. A progres- 
sive picture is recorded as being divided into two screen 40 
pictures separated from each other along a vertical line. 
These two screen pictures are represented by a field 
signal starting from an odd line and a field signal start- 
ing from an even line. These signals are referred to as 
an Odd First signal and an Even First signal. In this 45 
specification, a recording unit of picture information of 1 
GOP or more which has been processed with interleav- 
ing is referred to as an interleave block or a frame group. 
The system according to the present invention is 
referred to as a multiple angle video data division multi- so 
plex (MADM) system. 

[0022] Figure 1 is a block diagram of an MADM sys- 
tem recording apparatus 2 for an optical disk according 
to the present invention. A progressive signal and a 3D 
signal can both be recorded. A right-eye signal of the 3D ss 
picture is referred to as an R-TV signal, and a left-eye 
signal is referred to as an L-TV signal. The R-TV signal 
and the L-TV signal are compressed into MPEG signals 



by MPEG encoders 3a and 3b. As a result, an R-MPEG 
signal and an L-MPEG signal as shown in part (2) of 
Figure 2 are obtained. These signals are processed 
with interleaving by an interleave circuit 4, so that an R- 
frame group 6 including R-frames 5 corresponding to 1 
GOP or more of the R-MPEG signal and an L-frame 
group 8 including L-frames 7 corresponding to 1 GOP or 
more of the L-MPEG signal are alternately arranged as 
shown in part (3) of Figure 2. The recording unit is 
referred to as an interleave block, and may also be 
referred to as a frame group in this specification. The R- 
frame group 6 and the L-frame group 8 include an iden- 
tical number of frames having an identical time period, 
so that the right-eye signal and the left-eye signal are 
synchronized with each other when being reproduced. 
The frame group is also referred to as a picture data 
unit. One picture data unit corresponds to 0.4 to 1 sec- 
ond. A rotation speed of a DVD is 1440 rpm, i.e., 24 Hz 
along the innermost track. Accordingly, an interleave 
block corresponds to one or more rotations or further, 
10 to 20 rotations as shown in part (4) of Figure 2. 
Returning to Figure 1. address information is output 
from an address circuit 13. Progressive/3 D picture 
arrangement information is output from a progres- 
sive/3D picture arrangement information output section 
10. These pieces of information are recorded on the 
optical disk by a recording circuit 9. The progressive/3 D 
picture arrangement information includes an identifier 
which indicates whether or not a progressive or 3D pic- 
ture is present on the optical disk, or a progressive/3 D 
picture arrangement table 14 shown in Figure 4. As 
shown in Figure 4, a TEXTDT file 83 includes, for each 
VTS, 3D pictures for the right and left eyes and angle 
numbers and cell numbers in which the progressive sig- 
nal is located. Since a PGC file of each VTS includes a 
starting address and a termination address of each cell, 
the starting address and the termination address of 
each cell are included in the progressive/3 D picture 
arrangement information. Based on the arrangement 
information and identification information, the reproduc- 
tion apparatus outputs a progressive picture or a 3D pic- 
ture correctly as progressive outputs or R and L outputs. 
When ordinary pictures of different contents from each 
other are output as R and L outputs in error, the user will 
feel uncomfortable since the pictures for the right eye 
and the left eye are not related to each other. The pro- 
gressive/3D picture arrangement information or pro- 
gressive/3D picture identifier have an effect of avoiding 
the output of such unpleasant pictures. The manner of 
using the progressive/3 D picture arrangement informa- 
tion and progressive/3 D picture identifier will be 
described in detail later together with a description of 
the reproduction apparatus. 

[0023] In the recording apparatus shown in Figure 1 . 
a 525P or other progressive signal can be recorded with 
multiple angles. Specifically, a progressive signal is 
divided into a sum component and a difference compo- 
nent by a division section 38, thereby creating two inter- 
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lace signals. The two interlace signals are encoded by 
the two MPEG decoders 3a and 3b. In this case, a 
VPTS which is synchronized with an APTS of an audio 
signal is provided to a first MPEG signal and a second 
MPEG signal by a VPTS provision section 81 . Such pro- 5 
vision will be described in detail later. 
[0024] A specific method for creating 3D picture 
arrangement information will be described. A DVD-for- 
mat optical disk has files of a directory or table of con- 
tents stored in a standardized manner in a recording 
starting area thereof. However, these files do not 
include any description on 3D pictures. Accordingly, a 
3D picture logical arrangement file 53 including a 
3D/PG picture logical arrangement table shown in Fig- 
ure 18 is provided, so that a reproduction apparatus 
conforming to 3D reproduction reads the file. An ordi- 
nary 2D reproduction apparatus cannot read the 3D/PG 
picture logical arrangement file 53 but provides no prob- 
lem since such an ordinary 2D reproduction apparatus 
does not reproduce a 3D picture. 
[0025] Hereinafter, the table in Figure 18 will be 
described. DVD video information includes a three-layer 
logical hierarchy. The three layers are a video title set 
(VTS) layer representing a movie or other work, a part 
of video title (PVT) layer representing a chapter in the 
title, and a cell (Ceil) layer representing a stream in the 
chapter. 

[0026] The arrangement of 3D pictures in each layer 
will be described. "000" indicates that there is no 3D or 
progressive cell; "110" indicates that all cells are 3D 
cells; and "001" indicates that there are 3D cells and 
non-3D cells. 

[0027] In Figure 18, regarding the VTS layer, the sta- 
tus of title 1 is "001"; i.e., the VTS layer of title 1 includes 
both 3D and ordinary cells. The status of title 2 is "110"; 
i.e.. all the ceils in the VTS layer of title 2 are 3D cells. 
The status of title 3 is "000"; i.e., there are no 3D cells in 
the VTS layer of title 3. Accordingly, information on 3D 
pictures is not necessary regarding the lower layers of 
titles 2 and 3. 

[0028] Regarding PVT layer of title 1. the status of 
chapter 2 is "000"; i.e., there are no 3D ceils in the PVT 
layer of chapter 2. The status of chapter 3 is "1 10"; i.e., 
all the cells are 3D ceils in the PVT layer of chapter 3. 
The status of chapter 1 is "001"; i.e., there are both 3D 
ceils and the ordinary cells in the PVT layer of chapter 
1. Regarding the cell layer of chapter 1, cells 1 and 2 
correspond to R and L data of a first stream. Cells 3 and 
4 correspond to R and L data of a second stream. In 
cells 5 and 6, ordinary pictures are recorded. In the 
embodiment where the 3D/PG picture logical arrange- 
ment file 53 is separately recorded on the optical disk in 
this manner, the conventional file is not altered. Accord- 
ingly, compatibility between the 3D/PG pictures and the 
ordinary pictures is realized. The logical information 
reveals all the physical information on the optical disk. 
Accordingly, a malfunction of displaying ordinary pic- 
tures of two different contents for the right eye and the 



left eye is prevented. Moreover, the 3D picture can be 
appropriately reproduced and decoded so that R and L 
data are provided to the right eye and the left eye from 
the correct output sections. 

[0029] With reference to the flowchart of Figure 1 9, a 
process for determining whether or not each cell 
includes a 3D or progressive picture based on the 
3D/PG picture logical arrangement table 52 will be 
described. In step 51a, the 3D/PG picture logical 
arrangement table 52 is read from a first recording area 
of the optical disk. In step 51 b, the VTS layer of title n as 
shown in Figure 18 is checked. When the status of the 
VTS layer is "000", it is determined that no 3D or pro- 
gressive cell is included and thus 3D processing is not 
performed. When VTS=1 10 in step 51c, all the cells are 
processed as 3D cells in step 51 d. In step 51 e, odd ceils 
are processed as including a left-eye picture and even 
cells are processed as including a right-eye picture. In 
step 511, a menu screen is caused to indicate that all the 
cells in title n are 3D cells. When VTS=001 in step 51 g, 
the arrangement information of chapter n of the lower 
layer is checked in step 51 i. When PVT=000 in step 51 j, 
it is determined that chapter n include no 3D or PG cells 
in step 51k. When PVT=110 in step 51m, it is deter- 
mined that all the cells in chapter n are 3D cells in step 
51 n. Then, the processing goes to step 51 d, where the 
menu screen indicates that the all the cells in chapter n 
are 3D cells. When PVT=001 in step 51 p, each of the 
cells in that chapter is checked. When Cell=000 in step 
51s regarding one cell, it is determined that the cell is 
not a 3D cell and the processing goes back to step 51 q. 
When Cell=m-R in step 51 u, it is determined that the 
cell corresponds to R data of stream m in step 51 v. 
When Cell=m-L in step 51 w, it is determined that the 
cell corresponds to L data of stream m in step 51 x. 
Then, the next cell is checked in step 51 q. 
[0030] In the embodiment where the 3D/PG picture 
logical arrangement table 52 is additionally recorded in 
this manner, it is effectively determined whether or not 
each of all the video titles, chapters and ceils includes 
3D data, PG data or neither of such data. 
[0031) This will be described with respect to the top 
view of the optical disk in Figure 3. An optical disk 1 has 
one spiral track formed therein. The R-frame group 6 is 
recorded on a plurality of R tracks 11, 11a and 11b. In 
actuality, the R-frame group 6 is recorded on 5 to 24 
tracks. The L-frame group 8 is recorded on L tracks 1 2, 
1 2a and 1 2b, and the next R-frame group 6a is recorded 
on R tracks 11c, 11d and 11e. 
[0032] Hereinafter, a reproduction operation will be 
described with reference to the block diagram of the 3D 
reproduction apparatus according to the present inven- 
tion in Figure 5 and the timing diagram in Figure 6. 
When a signal from the optical disk 1 is reproduced by 
an optical head 15 and an optical signal reproduction 
circuit 24 and a 3D picture identifier is detected by a 3D 
picture arrangement information reproduction section 
26, or when picture data which has been determined to 
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have a 3D picture based on a 3D picture arrangement 
table 14 shown in Figure 4 is to be reproduced and an 
input section 19 or the like issues an instruction to out- 
put a 3D picture; a switch section 27 is controlled so that 
an R signal and an L signal are output from an R output 5 
section 29 and an L output section 30 and so that the R 
and L signals are output alternately on a field-by-field 
basts from an RL mixture circuit 28. The control of the 
switch section 27 is performed simultaneously with the 
processing of the 3D picture. 

[0033] With reference to Figures 5 and 6, an operation 
for reproducing a 3D picture will be described. As 
described with reference to part (3) of Figure 2, the R- 
frame group 6 and the L-frame group 8 are alternately 
recorded on the optical disk. The R-frame group 6 and 
the L-frame group 8 each include frames corresponding 
to n GOPs, where n is an integer of one or more. Figure 
85 represents such a state in detail. Two (right and left) 
streams are recorded on the disk alternately. Each 
stream includes intra-frame encoded frame data repre- 
sented as I and inter-frame encoded frame data repre- 
sented as B or P, and is divided into interleave units with 
the intra-frame encoded frame as a disconnection point. 
[0034] In Figure 6, part (1) shows the entirety of the 
disk, and part (2) shows a part thereof. An output signal 
from an optical signal reproduction circuit 24 in Figure 5 
is represented as part (2) of Figure 6. The signal is 
divided into an R signal and an L signal by a switch sec- 
tion 25, and the time axes of the R signal and the L sig- 
nal are matched to an original time axis respectively by 
a first buffer circuit 23a and a second buffer circuit 23b. 
By this operation, input signals, shown in part (4) of Fig- 
ure 6. to be input to R- and L-MPEG decoders are 
obtained. The signals are respectively processed by 
MPEG decoders 16a and 16b in Figure 5. Thus, R and 
L output signals which are synchronized with each other 
as shown in parts (6) and (7) of Figure 6 are sent to a 
picture output section 31 . An audio signal is extended 
by an audio output section 32 and then output. 
[0035] Since the two (R and L) signals are output 
simultaneously in this manner, a flickerless picture is 
obtained by sending a 60 fps (frames/sec.) signal from 
each of the R output section 29 and the L output section 
30 to the 3D TV having two (R and L) outputs. In the 
embodiment where an RL mixture signal having 60 
fields/sec. is sent from the RL mixture circuit 28, a 3D 
picture can be viewed with an ordinary TV and 3D spec- 
tacles, although the picture flickers. In the embodiment 
where an RL mixture signal having 120 fields/sec. is 
output, a flickerless 3D picture can be viewed with a 2X 
scan TV and 3D spectacles. In the case where a 3D pic- 
ture is not being output as a 3D picture, a signal is 
added by a "3D" display signal output section 33 so that 
the TV screen display a symbol indicating "3D". Then, 
the user is notified that he/she is viewing 3D software in 
a 2D mode and is urged to switch to the 3D output 
mode. In the embodiment where a 3D control signal 
generated by a 3D spectacle control signal generation 



section 33a for switching right and left shutters of the 3D 
spectacles is detected from a frame synchronization 
signal for a decoding signal or from the RL mixture cir- 
cuit 28 and output to an external device, a synchroniza- 
tion signal for the 3D spectacles is obtained. 
[0036] When a line memory 28c of an n-screen syn- 
thesis section 28b in Figure 90 is used, n pieces of pic- 
tures (e.g., two pictures) are output on a TV screen as 
one NTSC signal picture in which the two pictures are 
synthesized. Therefore, two angles can be viewed with 
an ordinary TV. A conventional 1 X reproduction appara- 
tus inconveniently displays only one angle at one time 
out of multiple angles. The present invention allows two 
streams to be reproduced simultaneously with a 2X 
reproduction apparatus and the MADM reproduction 
system, and also allows two screens to be displayed 
simultaneously. Accordingly, it is not necessary to 
switch the multiple angles. 

[0037] As shown in Figure 90 in detail, when the line 
memory 28c of the n-screen synthesis section 28b is 
used, a two-picture display 28f of two pictures A and B 
having the same size is obtained. Since a line memory 
has a simple structure and is integrated into an IC, the 
n-screen picture display is obtained with a simple struc- 
ture. When a frame memory 28d is used, a two-picture 
display 28g of two pictures having different sizes is 
obtained by a zoom signal from a zoom signal genera- 
tion section 28e. Since the user can arbitrarily set the 
size by remote control, the TV picture can be advanta- 
geously viewed at an optimum size. 
[0038] In the block diagram in Figure 5, two MPEG 
decoders are used. The structure is simplified by the cir- 
cuit configuration shown in Figure 7. The first MPEG 
signal and the second MPEG signal are synthesized 
into one MPEG signal by a synthesis section 36, and a 
2X clock is generated by a 2X clock generation section 

37. A 2X calculation is performed by a 2X clock-type 
MPEG decoder 16c, and the data is extended and out- 
put as R and L video signals through a division section 

38. Such a circuit configuration advantageously limits 
an increase in the cost since it is only necessary to add 
a 16 MB SD-RAM to a memory 39 of an existing 2D 
reproduction apparatus. 

[0039] With reference to Figure 7, synchronous repro- 
duction of two streams which is important in decoding 
3D picture data and progressive picture data will be 
described. First, it is necessary to adjust vertical and 
horizontal synchronization of two streams within a sin- 
gle line. In order to do this, a first MPEG decoder 16a 
and a second MPEG decoder 16b are started substan- 
tially simultaneously by a vertical/horizontal synchroni- 
zation control section 85c to synchronize the decoders 
1 6a and 1 6b. Then, it is necessary that the outputs from 
the two decoders should be pictures having an identical 
VPTS. This will be described with reference to the f tow- 
chart in Figure 57 and Figure 7. In step 241a, the syn- 
chronization of a first decoder and a second decoder is 
cancelled. In step 241 b, the decoders are synchronized 
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with each other vertically and horizontally. In step 241c, 
an APTS of an audio signal is read, and the APTS value 
is set as an initial value of an STC of the first decoder 
and an STC of the second decoder. In step 241 e, 
processing of the first decoder is started. In step 241 f , it 5 
is checked whether or not a first VPTS has reached the 
initial value. If yes, decoding is started in step 241 g. In 
step 241 h, a processing delay time period of the first 
decoder is calculated, and the VPTS of the decoder out- 
put is adjusted so that the APTS and the VPTS are syn- 
chronized with each other. Since the second decoder is 
processed in the same manner, the picture from the first 
decoder and the picture from the second decoder are 
synchronized with each other. Thus, the decoder out- 
puts, i.e., the first MPEG signal and the second MPEG 
signal are synchronized within one line. Then, the syn- 
chronization on a dot-by -dot basis is obtained by a 
video signal synchronization section 36a of the synthe- 
sis section 36. An original progressive picture is 
obtained even by a sum calculation. As shown in Figure 
5, in the case where an APTS 64 is read by the audio 
decoder 16c and an identical APTS is set in registers 
39a and 39b of the STCs of the two MPEG decoders 
1 6a and 1 6b, an audio stream and the two video stream 
are automatically synchronized with one another. 
[0040] In the present invention, when the buffer cir- 
cuits 23a and 23b underflow, either one of the pictures 
is disconnected, as a result of which a disturbed pro- 
gressive picture is output. In order to avoid this, the buff- 
ering amounts of the two buffer circuits are controlled by 
a buffer amount control section 23c as shown in Figure 
5. This operation is illustrated in the flowchart shown in 
Figure 56. First, in step 240a, a maximum interleave 
value among the NAVI information of each disk is read, 
and a maximum value of 1 ILB in one main interleave 
block is set. The maximum value is usually 512 sectors, 
i.e .about 1 MB. When the maximum value is set below 
1 MB by a specific format, that value is set as the maxi- 
mum value. Next, when an instruction to simultaneously 
reproduce the main and sub interleave blocks is issued 
in step 240b, if the buffering amount of the first buffer 
circuit 23a is 1 ILB or less in step 240c. reproduction is 
performed from the main interleave block, and an 
instruction to transfer the data to the first buffer circuit 
23a is issued. Then, the processing goes back to steps 
240b and 240c. The transfer is stopped in step 240d 
when the buffering amount of the first buffer circuit 
exceeds 1ILB. Since the data in the buffer circuit 23a 
becomes 1 1LB or more in this manner, underflow is pre- 
vented. 

[0041 ] In step 240f, a maximum value of a sub inter- 
leave block of 1 ILB-Sub is set in the buffer circuit 23b. 
Simultaneous reproduction is performed in step 240g. 
When the data in the second buffer circuit 23b is 1/2 
ILB-Sub or less, data is read into the buffer circuit in 
step 240i. When the data is more than 1/2 ILB-Sub in 
step 240I, the reading is stopped in step 240i. 
[0042] As shown in part (4) of Figure 45. the data 



amount of 1/2 ILB is sufficient in the second buffer cir- 
cuit. Accordingly, the buffering amount can be reduced 
to half. The buffer control in Figure 56 eliminates the 
underflow of the buffer circuits, thus reducing distur- 
bance in the synthesized picture during reproduction. 
[0043] Next, a process for reproducing only an R sig- 
nal by 1X rotation of the optical disk will be described. 
The standard rotation speed of a DVD reproduction 
apparatus is referred to as "1 X", and the speed twice the 
standard rotation speed is referred to as "2X". Since it is 
not necessary to rotate the motor at 2X, a 1 X instruction 
is sent from a control section 21 to a rotation speed 
alternation circuit 35 to reduce the rotation speed. A 
process for reproducing only an R signal at 1 X rotation 
from an optical disk storing the R signal and an L signal 
will be described with reference to the timing diagram in 
Figure 8. As described with reference to parts (1) and 

(2) of Figure 6. the optical disk according to the present 
invention has the R-frame group 6 and the L-frame 
group 8 alternately recorded. This is shown in parts (1) 
and (2) of Figure 8. 

[0044] A comparison between the signal shown in 
parts (1) and (2) of Figure 8 and a signal shown in part 

(3) of Figure 8 corresponding to one rotation of the disk 
indicates that the optical disk rotates 5 to 20 times while 
one frame group is reproduced. A track jump of the opti- 
cal head from the R-frame group 6 to the next R-frame 
group 6a requires several tens of milliseconds. Where 
the wait time period is one rotation, which is the maxi- 
mum, the data in the R-frame group 6a can be repro- 
duced within two rotations. This is shown in parts (4) 
and (5) of Figure 8, which are timing diagrams of the 
reproduction signal and the signal corresponding to one 
rotation of the disk. The time axis of the reproduction 
signal in part (4) of Figure 8 is adjusted by the buffer cir- 
cuit 23a in Figure 5, and an MPEG signal having contin- 
uous R frames as shown in part (6) of Figure 8 is output 
from the buffer circuit 23a. This signal is extended to be 
an R video signal as shown in part (7) of Figure 8 by the 
MPEG decoder 16a. By selecting a different channel in 
the same manner as the case of the R signal, a 2D sig- 
nal of the L channel is obtained. According to the 
present invention, the R or L channel is assigned to a 
frame group of 1 GOP or more and the frame group is 
recorded continuously over a plurality of tracks. Thus, 
even when a 3D optical disk is reproduced by a 1X 
reproduction apparatus, a 2D output of only the R chan- 
nel is obtained. 

[0045] As can be appreciated from this, as shown in 
the block diagram of Figure 9, a reproduction apparatus 
specifically for 2D display is obtained by altering the 
structure of the 3D reproduction apparatus in Figure 5 
so that there is only one buffer circuit 23 in lieu of two, 
one MPEG decoder 16 in lieu of two, and one picture 
output section 17. Such a 2D reproduction apparatus 40 
includes the 3D picture arrangement information repro- 
duction section 26, and therefore, reproduces a 3D pic- 
ture identifier and arrangement information of the 3D 
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optical disk 1. Accordingly, when the data in the optical 
disk 1 is reproduced by the 2D reproduction apparatus, 
data in either one out of the R and L channels is output. 
Since the R and L channels correspond to an identical 
picture, it is a waste of time to output the pictures in the 5 
R and L channels by switching the channels by a chan- 
nel selection section 20. According to the present inven- 
tion, a 3D channel output control section 41 restricts 
data to be output from only either channel, for example, 
the R channel, using the 3D picture identifier. Thus, data 
in only the R or L channel of identical video contents is 
output, avoiding the situation in which the user selects 
an unnecessary channel. 

[0046] When a 3D picture is provided, the "3D" display 
signal output section 23 displays the symbol "3D" on the 
screen or a display section 42 of the reproduction appa- 
ratus. Therefore, the user can recognize that the picture 
is a 3D picture. The optical disk according to the present 
invention provides both 2D and 3D pictures when repro- 
duced by the 3D reproduction apparatus 43 in Figure 5 
and a 2D picture when reproduced by the 2D reproduc- 
tion apparatus in Figure 9. In this manner, the compati- 
bility between the 2D reproduction apparatuses and 3D 
reproduction apparatuses realized. 
[0047] Now, returning to the 3D reproduction appara- 
tus, use and effect of a 3D picture identifier will be 
described. 

[0048] Figure 13 is a timing diagram of a 3D picture 
identifier and an output signal. One interleave block is 
defined as a time unit '1". In parts (3) through (6) of Fig- 
ure 13, a delay time period of 1t is generated although 
not shown. As shown in part (1) of Figure 13, the state 
of the 3D picture identifier is changed from "1" to "0" at 
t=t7. As shown in part (2) of Figure 13, the R-frame 
groups 6, 6a and 6b and the L-frame groups 8, 8a and 
8b of a 3D picture are recorded from t1 through t7. From 
t7 through t1 1 , pictures A and B of different contents are 
recorded. In more detail, first-frame groups 44 and 44a 
of picture A and second-frame groups 45 and 45a of 
picture B are recorded. Since the DVD format does not 
define 3D pictures, a 3D picture identifier is not included 
in the data or directory information of the disk. Accord- 
ingly, a 3D picture arrangement information file needs to 
be read when the optical disk is started. As shown in 
parts (3) and (4) of Figure 13, from t1 through t7, data in 
first time domains 46, 46a and 46b can be output to the 
R channel, and data in the second time domains 47, 
47a and 47b can be output to the L channel. After t=t7, 
no 3D picture identifier is available. Accordingly, data in, 
for example, first time domains 46c and 46d is output to 
both the R and L channels. As shown in parts (5) and 
(6) of Figure 13, a different output system is adopted for 
a mixture output. From t1 through t7 when the 3D pic- 
ture identifier is "1", even field signals 48 and 48a and 
odd field signals 49 and 49a are alternately output from 
one output at a field frequency of 60 Hz or 120 Hz. In 
more detail, data in the first time domains 46 and 46a is 
output as the even field signals, and data in the second 



time domains 47 and 47a is output as the odd field sig- 
nals. 

[0049] After t=t7 when the 3D picture identifier is not 
available, data in the first time domains 46c and 46d is 
output as both the even field signals 48d and 48e and 
the odd field signals 49d and 49e. 
[0050] As described above, the manner of outputting 
signals to the 3D display is changed in accordance with 
whether or not the 3D picture arrangement information 
indicates the absence of the 3D picture. In this manner, 
it is prevented that pictures of different contents from 
each other are presented for the right and left eyes of 
the user. Without such a function, the following incon- 
venience occurs. In the case where the first time 
domain and the second time domain of the optical disk 
start to include different contents from each other while 
the user is viewing a right-eye picture and a left-eye pic- 
ture of the same contents, a picture of content A is pre- 
sented to the right eye and a picture of content B is 
presented to the left eye. Such an abnormality makes 
the user feel uncomfortable. 

[0051] With reference to the flowchart of Figure 17, 
the above-described process will be described in detail. 
In step 50a, an optical disk is mounted. In step 50b, a 
file of a list of contents in the optical disk is read. The file 
does not include a 3D picture identifier. In step 50c, a 
3D picture arrangement information is read from a 
TXTDTfile of the disk 

[0052] In step 50d, the list of contents is displayed 
based on the 3D picture arrangement information. At 
this point, "3D" is displayed for each of the contents on 
the menu screen, so that the user can recognize that 3D 
contents are available. This information can be in one 
area of the optical disk or included in navigation infor- 
mation provided on a data-by-data basis. 
[0053] In step 50e, data in a specific address is repro- 
duced. In step 50f. it is determined whether or not the 
data is 3D data with reference to the 3D picture arrange- 
ment information. If yes, in step 50g. signals are 
decoded. For example, an R signal in the first time 
domain 46 and an L signal in the second time domain 
47 are decoded. TTie data in the first time domain 46 is 
output as the right-eye picture, and the data in the sec- 
ond time domain 47 is output as the left-eye picture. The 
pictures are synchronized. For reproduction of the next 
data, the processing goes back to steps 5Qe and 50f, 
where it is determined whether or not the picture is a 3D 
picture. If no, the processing goes to step 50h, where 
the data in either one of the first time domain 46 or the 
second time domain 47 is output as both the right-eye 
picture and the left-eye picture. In other words, the 
same picture is output for the right eye and the left eye. 
Thus, pictures of different contents are prevented from 
being output to the right eye and the left eye. 
[0054] According to the present invention, an ordinary 
picture and a 3D picture both of the interleave block sys- 
tem are reproduced in different manners. This will be 
described, hereinafter. 
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[0055] With reference to Figure 14, part (1) shows 
data recorded on the optical disk. A first interleave block 
56 includes data A1 and a leading address a5 of the first 
interleave block 56 to be accessed next, i.e., the next 
pointer 60. Accordingly, as shown in part (2) in Figure 
14, when reproduction of the first interleave block 56 is 
terminated, only the address of the pointer 60a needs to 
be accessed. Thus, the optical head performs a track 
jump to access the next first interleave block 56a within 
1 00 ms and reproduces data A2. Data A3 is reproduced 
in same manner. In this manner, contents A1 through 
A3 are reproduced. 

[0056] Part (3) of Figure 1 4 is related to an optical disk 
having 3D pictures for R and L outputs. The optical disk 
includes the same pointer 60 in order to have the same 
format as in part (1) of Figure 14 for compatibility. 
Accordingly, a 3D picture is not reproduced unless the 
pointer 60 is ignored. 

[0057] A 3D picture identifier 61 of each cell is defined 
based on the 3D picture logical arrangement table. 
Accordingly, 3D picture identifiers 61 of interleave 
blocks 54, 55, 56 and 57 are logically defined. This is 
shown in part (3) of Figure 14. The pointer cannot be 
used as it is in order to reproduce data R1 and L1 and 
then reproduce data R2 and L1 after a track jump. Spe- 
cifically, when reproduction of the R interleave block 54 
is completed, the address of the pointer a5 is not 
accessed. Rather, after reproduction of the next L inter- 
leave block 55, the optical head performs a track jump to 
the pointer a5 of the R interleave block, in this case, the 
pointer 60b of the L interleave block 55 is ignored. For 
reproducing an interleave block where the 3D picture 
identifier is available, it is advantageous to change the 
manner of accessing the pointer address from the case 
of the reproduction of an ordinary picture, the advan- 
tage being that R and L pictures are continuously repro- 
duced as shown in part (4) of Figure 14. 
[0058] With reference to flowcharts in Figures 1 5 and 
16, a process of changing the manner of accessing the 
pointer address when reproducing an interleave block 
using a 3D picture arrangement information will be 
described. 

[0059] In step 62a, an access instruction to an 
address of a specific cell is issued. In step 62b, it is 
determined whether or not the picture to be accessed is 
3D with reference to the 3D picture arrangement infor- 
mation. If the picture is determined not to be 3D in step 
62c, the processing goes to step 62t, where the picture 
is processed as an ordinary picture. If the picture is 
determined to be 3D in step 62c, the processing goes to 
step 62d, where it is checked whether or not the user 
intends to reproduce the picture as a 3D picture. If no. 
the "3D" mark is displayed on the screen and the 
processing goes to step 62t. 

[0060] If yes in step 62d, the 3D picture arrangement 
information is read in step 62e, and the locations of the 
R and L interleave blocks are calculated based on, for 
example, the chapter number, R cell number and L cell 



number. In step 62g, the nth R interleave block is repro- 
duced. In step 62h, the pointers recorded in the R inter- 
leave block and the L interleave block are read and 
stored in the pointer memory. In step 62i, the previous 
5 pointer (i.e., the (n-1)th pointer AL (n)) is read from the 
pointer memory. In step 62j, it is checked whether or not 
pointers AL(n) and AR(n) are continuous with each 
other. If no, a jump to the address AL(n) is performed in 
step 62k. 

10 [0061 ] As shown in Figure 1 6, in step 62m, the n th L 
interleave block is reproduced. In step 62n, the first 
VPTS and the second VPTS are output in synchroniza- 
tion using the pointer AR(n+1). In step 63g, the first 
VPTS and the second VPTS are synchronized using 

is APTS of the main interleave block. If in step 63h, the 
signal is found to be a PG, i.e., progressive signal, in 
step 63i. a sum and a difference of the two decoding 
output signals are found to and a vertical synthesis is 
performed. Thus, a picture having an improved vertical 

20 resolution such as a 525P picture is obtained. 

[0062] If the signal is found to be wide 525P(i) in step 
63], a sum and a difference of the two decoding output 
signals are found and a horizontal synthesis is per- 
formed. Thus, a picture having an improved horizontal 

25 resolution such as a wide 525P(i) picture of, for exam- 
ple, 1440x480 pixels is obtained. In step 62 p, it is 
checked whether or not the reproduction of all the 
streams is completed. In step 62q, it is checked whether 
or not the n'th L interleave block and the (n+1)th R inter- 

30 leave block are recorded continuously with each other. If 
no, a track jump to the AR(n+1) is performed in step 62r 
and the processing goes back to step 621 If yes in step 
62q, the processing directly goes back to step 621 
[0063] In the case where the "30" mark mentioned 

35 regarding step 62t is not displayed on the screen, the 
starting address A(1) of cell h is accessed and the first 
interleave block is reproduced. Then, in step 62u, the 
nth interleave blocks of address A(n) are sequentially 
reproduced. In step 62 v, the pointer address A(n+1) for 

40 accessing the next interleave block by jumping is read. 
In step 62w, it is checked whether or not the reproduc- 
tion of all the data is completed. If yes, the processing 
goes back to step 62a. If no, in step 62x, it is checked 
whether or not A(n) and A(n+1) are continuous with 

45 each other. If yes, the processing goes back to the step 
before step 62u without jumping. If no, in step 62y, a 
jump to the address A(n+1) is performed. 
[0064] Figure 20 is a block diagram of a reproduction 
apparatus 65 according to the present invention. An 

so operation of the reproduction apparatus 65 for repro- 
ducing 2X progressive pictures, wide screen pictures 
and 720P pictures will be described. A signal repro- 
duced from an optical disk 1 is divided by a division sec- 
tion 8 into a first interleave block 66 and a second 

55 interleave block 67 each including frames correspond- 
ing to 1 GOP or more. The blocks are respectively 
MPEG-extended into frame video signals 70a and 70b 
each having 30 frames/sec. The video signal 70a is 
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divided by a field division section 71a into an odd field 
signals 72a and 73a. The video signal 70b is divided by 
a field division section 71b into an odd field signals 72b 
and 73b. Thus, 2-ch NTSC interlace signals 74a and 
74b are output. The wide screen picture reproduced by 
the reproduction apparatus in Figure 20 will be 
described later. 

[0065] With reference to Figure 22, an encoding oper- 
ation of a progressive video signal will be described. 
Progressive video signals 75a and 75b are input at time 
t1 and t2, and divided by a division section 38 into an 
Odd First interlace signal 244 and an Even First inter- 
lace signal 245. Where the nth line (e.g., 1st line) of the 
interlace signal 244 is labeled as "An" and the n th line 
(e.g., 2nd line) of the interlace signal 245 is labeled as 
"Bn", a vertical filter 142 performs a sum calculation, 
i.e., 1/2(An+Bn), thus obtaining a low frequency compo- 
nent. In other words, a function of an interlace interfer- 
ence removal filter 141 is performed. In the case where 
the resultant component is reproduced from only one 
angle by a conventional reproduction apparatus, an 
NTSC signal with no interlace interference is obtained. 
"An" of the interlace signal 244 is also divided by a color 
division section 242 and input to a color synthesis sec- 
tion 243 without passing through the vertical filter 142. 
In the color synthesis section 243, the signal from the 
color division section 242 and the signal from the verti- 
cal filter 142 are synthesized (1/2(A+B)). Then, the 
resultant signal is compressed by an MPEG encoder. 
[0086] A vertical filter 1 43 performs a difference calcu- 
lation, i.e., 1/2(An-Bn), thus obtaining a high frequency 
component, i.e., difference information. This signal is 
compressed by an MPEG encoder without being com- 
bined with the color signal. Accordingly, the amount of 
the difference information is advantageously reduced by 
the amount of the color signal. 
[0067] Figure 23 is a view representing the concept of 
the structure of Figure 22. This system is referred to as 
multiple angle video data division multiplex system 
(MADM) since a video signal is divided into vertical or 
horizontal high frequency and low frequency compo- 
nents and recorded in the state of being divided into pic- 
tures of multiple angles. As shown in Figure 23, a signal 
is divided into a basic signal (sum signal) and a sub sig- 
nal (difference signal) by a sum calculation section 141 
and a difference calculation section 143. The resultant 
signals are MPEG-encoded and then recorded as an 
interleave block in units of 1 GOP. At this point, the 
amount of the information can be reduced by 20% by 
performing 3-2 transform of the basic signal and the sub 
signal in synchronization with each other. It is efficient to 
use, as the basic signal, "IBBPBBPBBPBBPBB" which 
is shown as a main GOP structure 244 used for the ordi- 
nary MPEG encoding. In this structure, an I frame 246, 
B frames 248 and P frames 247 are alternately 
arranged. In the case of the difference signal, experi- 
ments have shown that it is efficient to have a structure 
including only I frames 246n and P frames 247 due to 



the profile pattern, for example, "IPPPPPPPIPPPPPPP" 
shown in a sub GOP structure 245. The efficiency is 
improved by changing the setting for the sub GOP struc- 
ture. 

5 [0068] Figure 23 shows an example in which a 525P 
video signal is divided into two in a vertical direction. 
Figure 58 (described below) shows an example in which 
a 525P video signal is divided into two in a horizontal 
direction. In an alternative manner, a 60-frame 525P 

io signal is divided by frame division means into 30 odd 
frames and 30 even frames. In this case, the respective 
30P signals are transformed into two 60-field interlace 
signals, and each of the signals are MPEG-encoded to 
be recorded in the MADM system. Such encoding is 

is performed in a progressive manner, and therefore 
encoding efficiency is improved as in the case of the 
movie. Thus, the recordable time period of the same 
disk is extended. 

[0069] When such a signal is reproduced by a non- 
20 MADM reproduction apparatus, a 30P (one-channel) 
525 interlace signal is reproduced. Such a signal lacks 
necessary frames and is distorted. 
[0070] When such a signal is reproduced by an 
MADM reproduction apparatus, a 30P signal as a basic 
25 signal and a 30P signal as a sub signal are reproduced. 
These two 30 -frame signals are synthesized into a 60- 
frame normal 525P signal by frame synthesis means 
including a frame buffer, and then output. 
[0071] When a line doubler is added to an output sec- 
30 tion for the 525P signal, a 1050P video signal is 
obtained. 

[0072] When a 525 interlace signal is input to a sum 
signal section of the synthesis section of the MADM 
reproduction apparatus and the value of 0 is input to a 

35 difference signal section of the synthesis section, a 
525P picture is obtained. Such a manner of input has 
the same effect as the line doubler. This method allows 
even an 525 interlace signal to be output as a 525P sig- 
nal. Accordingly, all types of pictures can be viewed by 

40 simply connecting one cable to a progressive input ter- 
minal of the MADM reproduction apparatus. 
[0073] In Figure 23, 1/2(A+B) and 1/2(A-B) are used 
as expressions for calculation for a two-tap filter. The 
separation frequency corresponds to about 300 scan- 

45 ning lines. 

[0074] When a four-tap filter as shown in part (c) of 
Figure 46 is used, the number of scanning lines corre- 
sponding to the separation frequency can be reduced to 
about 200. An example of using such a frequency will 

so be described. When the amount of information repre- 
sented by the basic signal is too large to encode the 
information, it is advantageous to reduce the number of 
scanning lines corresponding to the separation fre- 
quency to less than 300, for example, 220. In this case, 

55 the amount of information represented by the basic sig- 
nal is significantly reduced and thus the information can 
be encoded. Although the amount of information repre- 
sented by the sub signal, i.e., difference signal is 
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increased, it is not serious because the difference signal 
does not include color information and thus originally 
contains only a small amount of information. Therefore, 
there is no problem of insufficiency in the encoding 
capability of the encoder. An original picture is repro- 5 
duced normally by the following setting. The filter infor- 
mation can be contained in a filter identifier 144 in 
Figure 50. The filter characteristics are changed in units 
of 1 cell or 1 GOP by altering the constant of the sum 
calculation section and the difference calculation sec- 
tion by filter separation frequency alteration means of 
the reproduction apparatus with reference to identifiers 
100, 101 and 111. By such setting, a high rate picture, 
which is usually difficult to encode, can be encoded. 
[0075] Returning to Figure 22, the MPEG encoder 
section synthesizes an odd interlace signal 79a and an 
even interlace signal 80a and also synthesizes an odd 
interlace signal 79b and an even interlace signal 80b, 
thus obtaining frame signals 81a and 81b. The frame 
signals 81a and 81b are compressed by MPEG com- 
pression sections 82a and 82b to generate compres- 
sion signals 83a and 83b. Interleave blocks 84a, 84b 
and 84c each including 10 to 15 frames of the compres- 
sion signals 83a and 83b corresponding to 1 GOP or 
more are generated. Compression signals obtained 
from an identical progressive signal are provided with 
an identical time stamp by time stamp provision means, 
and then the signals are recorded on an optical disk 85. 
[0076] The progressive signal recorded on the optical 
disk 85 is reproduced by a 2X reproduction apparatus 
shown in Figure 21 . The reproduced signal is divided by 
a division section 87 into a stream of interleave blocks 
84a and 84c and another stream of an interleave block 
84b. Then, the streams are extended by extension sec- 
tions 88a and 88b into frame signals 89a and 89b each 
having 720x480 pixels. The progressive signal is 
divided by field division sections 71a and 71b into odd 
fields 72a and 72b, and even fields 73a and 73b on a 
time axis, as by the reproduction apparatus shown in 
Figure 20. 

[0077] In Figure 21 , unlike the apparatus in Figure 20, 
the odd fields 72a and 72b of channel A 91 and channel 
B 92 are synthesized by a synthesis section 90 using a 
sum calculation circuit and a difference calculation cir- 
cuit. The even fields 73a and 73b are synthesized in the 
same manner. Thus, channel A 91 and channel B 92 
are synthesized in a zigzag manner. As a result, pro- 
gressive signals 93a and 93b are obtained and output 
from a progressive video output section 94. 
[0078] In this manner, a progressive video signal, i.e., 
non-interlace NTSC signals of 525 scanning lines is 
obtained by the reproduction apparatus according to the 
present invention. In this example, a progressive signal 
of 480 scanning lines is obtained. The reproduction sec- 
tion 95 performs 2X reproduction. 
[0079] Advantageously, a movie or the like recorded in 
a conventional optical disk are also reproduced as a 
progressive picture. 



[0080] Figure 23 shows an example in which the sig- 
nal is divided in a vertical direction by the MADM sys- 
tem. With reference to Figure 58, an example in which 
the signal is divided in a horizontal direction by the 
MADM system will be described. A wide 525P picture 
of, for example, 1440x480P has been studied for mov- 
ies. Such a signal is transformed into an interlace signal 
of 1440x480i by a 3-2 transform section 174. The signal 
is divided by a horizontal filter section 206a into two in a 
horizontal direction. Figure 59 illustrates the principle of 
the filter in parts (a) and (b). As shown in part (b), 1440 
dots are divided into odd dots 263a and 263b, and even 
dots 264a and 264b. Where the odd dots are labeled as 
"Xn" and the even dots are labeled as "Yn", a sum sig- 
nal is obtained by X+Y and a difference signal is 
obtained by X-Y As a result, two 525 P or 525i signals, 
each of 720x480, are obtained as shown in part (b) of 
Figure 59. 

[0081 ] Returning to Figure 58, the number of horizon- 
tal dots of such a horizontal sum signal is reduced to 
720. Since the signal is passed through the horizontal 
filter, however, aliasing distortion is as low as that of an 
NTSC signal. A conventional reproduction apparatus 
reproduces only the sum signal and accordingly pro- 
vides a DVD picture of the same quality. The difference 
signal represents only a profile formed of line-drawing. 
However, since the difference signal is restricted by a 
second video signal output restriction provision section 
179 so as not to be reproduced by an ordinary repro- 
duction apparatus, no problem occurs. The sum signal 
and the difference signal are respectively encoded into 
MPEG streams by a first encoder 3a and a second 
encoder 3b. and subjected to interleaving in units of an 
interleave block of 1 GOP or more and MADM-muIti- 
plexed. 

[0082] As shown in Figure 50, in the case of a movie, 
a signal is transformed by a 3-2 transform section 174 
and MADM-recorded as an MPEG signal together with 
3-2 transform information 174a. 
[0083] In the case of the movie, 24 frames are repro- 
duced in one second. Accordingly, a 1440x480P pro- 
gressive picture is reproduced based on two interlace 
signals by a 2X reproduction apparatus. The scope size 
of the movie is 2.35:1 . The format of 1440x480P is suit- 
able for the scope size of 2.35:1 in terms of the aspect 
ratio. Thus, a wide screen 525P is effectively repro- 
duced. 

[0084] When a movie on the optical disk for a 1 X inter- 
lace reproduction apparatus is reproduced by the repro- 
duction apparatus shown in Figure 20, a 24-frames/sec. 
progressive signal is obtained in an MPEG recorder 
since a movie signal is a progressive signal having 24 
frames/sec. The progressive signal is reproduced by 
detecting that the optical disk includes a movie by 
detection means or by transforming the 24-frame/sec. 
signal into a 60-frame/sec. progressive signal by the 3- 
2 transform section 174. An interlace picture with no 
interference is obtained by tittering the progressive sig- 
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nal by a vertical filter with reference to the filter identifier. 
[0085] An optical disk 85 encoded with reference to 
Figure 22 is reproduced by the reproduction apparatus 
65 conforming to the progressive system. Then, a chan- 
nel- A interlace signal 74a is reproduced. A conventional 5 
interlace DVD player has only channel A but not channel 
B. Therefore, when the optical disk 85 according to the 
present invention is mounted on the conventional inter- 
lace DVD player, the channel -A interlace signal is 
obtained. As can be appreciated, an optical disk accord- 
ing to the present invention provides a progressive sig- 
nal when reproduced by a reproduction apparatus 
according to the present invention, and provides an 
interlace signal of the same contents when reproduced 
by a conventional reproduction apparatus. Thus, the 
optical disk according to the present invention realizes 
complete compatibility even with the conventional repro- 
duction apparatus. 

[0086] In the MPEG encoder shown in Figure 22, an 
interlace interference removal compression filter 141 is 
provided to significantly reduce the aliasing distortion. 
[0087] Hereinafter, encoding of a 3D picture will be 
described in detail. 

[0088] A right-eye signal 97 and a left-eye signal 98 
are input into a recording apparatus 99 in the same 
manner as the sum signal and the difference signal of 
the progressive signal described with reference to Fig- 
ure 22. Since this is an interlace signal, odd field signals 
72a and 72b and even field signals 73a and 73b are 
input every 1/60 second. The signals 72a and 73a and 
the signals 72b and 73b are synthesized by synthesis 
sections 101a and 101b into 1/30 sec. frame signals 
83a and 83b. These signals are compressed by com- 
pression sections 103a and 103b into compression sig- 
nals 83a and 83b. Interleave blocks 84a, 84b and 84c, 
each including frames of these signals corresponding to 
1 GOP or more, are generated. The interleave blocks 
84a, 84b and 84c are alternately located and recorded 
on the optical disk 1 . When data in the resultant optical 
disk is mounted on the reproduction apparatus shown in 
Figure 24 for reproduction, the 3D/PG picture arrange- 
ment information reproduction section 26 described 
above with reference to Figure 5 detects a PG identifier 
in the disk. Therefore, the reproduction apparatus (104) 
is put into a 3D reproduction mode as shown in Figure 
24. The 3D picture in the optical disk is divided by a divi- 
sion section 68 into channel A and channel B. The data 
in the channels are extended respectively by extension 
sections 88a and 88b and then divided into field signals 
by field division sections 71a and 71b. The operation of 
the reproduction apparatus up to this point is the same 
as in the case of Figure 21 . 

[0089] A feature of the reproduction apparatus shown 
in Figure 24 is that the field division section 71a outputs 
odd field signals and even field signals while switching 
the output order thereof by an output transform section. 
When the signals are sent to a progressive TV, i.e.. a TV 
having a field frequency of 120 Hz, the signals are out- 



put from a progressive output section 1 05 in the order of 
a channel-A odd field signal 72a. channel-B odd field 
signal 72b, channel-A even field signal 73a, and chan- 
nel-B even field signal 73b. Thus, the right-eye signals 
and the left-eye signals are output alternately and in the 
order of the odd field and then the even field. Accord- 
ingly, a f lickerless picture having matching right-eye and 
left-eye information is obtained through switch-type 3D 
spectacles. 

[0090] When the signals are sent to an ordinary TV, 
the channel-A odd field signal 72a and the channel-B 
even field signal 73b are output from an NTSC output 
section 106. Then, a 3D picture displaying natural 
motions is obtained through 3D spectacles although the 
picture includes flicker. 

[0091 ] By combining the progressive system and the 
3D picture reproduction system according to the 
present invention, a high definition 3D picture including 
a right-eye picture and a left-eye picture is realized. This 
will be described with reference to Figure 25. A repro- 
duction apparatus 1 07 performs 4X reproduction. When 
reproducing a DVD, 80% of such a transfer rate is suffi- 
cient. In the embodiment where interleave blocks 108a, 
108b, 108c and 108d of right progressive signals A and 
B and left progressive signals C and D are arranged 
with no interval as shown in Figure 25, the optical 
pickup does not need to jump for continuous reproduc- 
tion. In the case of DVD, only 80% of the information is 
reproduced. The reproduction rate can be 3.2X in lieu of 
4X in the case of continuous reproduction. Such a con- 
tinuous arrangement advantageously reduces the 
reproduction rate. 

[0092] The signal is divided into interleave blocks 
1 08a, 1 08b, 1 08c and 1 08d, and signals for channels A, 
B, C and D are reproduced. The video signals extended 
by extension sections 69a, 69b, 69c and 69d are syn- 
thesized by synthesis sections 90a and 90b as in Figure 
21, and two progressive signals are output from pro- 
gressive output sections 110a and 110b. The two pro- 
gressive signals are respectively a right-eye signal and 
a left-eye signal. Accordingly, a progressive 3D picture 
is obtained by the reproduction apparatus 107. When a 
4X MPEG chip is used, only one chip is sufficient and 
avoids an increase in the number of components. The 
4X MPEG chip realizes recording and reproduction of 
pictures of four different contents. In this case, pictures 
are displayed on a 4-part multi-screen TV simultane- 
ously with one optical disk. 

[0093] A feature of the present invention is to provide 
compatibility among all the apparatuses and media. 
When data on a disk 106 in Figure 25 is reproduced by 
a conventional reproduction apparatus, an interlace sig- 
nal for either the right eye or the left eye is output. The 
picture is not deteriorated although the reproduction 
time is reduced to 1/4. However, a two layer DVD stores 
data for 2 hours and 15 minutes. Almost all movies are 
accommodated in such a DVD. 
[0094] When data on the disk 106 in Figure 25 is 
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reproduced by a 2X 3Dfcrogressive reproduction appa- 
ratus according to the present invention, the user 
switches from a 3D interlace picture to a one-channel 
progressive picture or vice versa by sending an instruc- 
tion to a control section 21 through a channel selection § 
section 20 from an input section 19 (see Figure 9). As 
described above, the present invention has an effect of 
providing complete compatibility analogous to that 
between the monaural records and stereo records dis- 
cussed in the past. 

[0095] According to the 2X and 4X reproduction appa- 
ratuses according to the present invention, pictures of 
various qualities are obtained in various display man- 
ners. 

[0096] As described above, according to the present 
invention , when a 3D identifier is not available, the 
pointer is read and the optical head jumps. When a 3D 
identifier is available, the reproduction process is 
changed so that the pointer of one of the immediately 
previous interleave blocks is read and accessed. Thus, 
a 3D picture is recorded without changing the format. 
[0097] A method for performing recording and repro- 
duction while a scope-size movie screen is divided into 
two. 

[0098] In Figure 20, an optical disk 1 having two- 
screen interlace signals is reproduced. Now, with refer- 
ence to Figure 40, this concept is applied to a scope- 
size (2.35:1) super wide screen 154. The super wide 
screen 154 is divided into three, i.e., a center screen 

156 and side screens 157 and 158 by a screen division 
section 155. The position of division is represented by a 
center shift amount 159. The center picture 156d is 
compressed as a first video signal. The side pictures 

157 and 158 are compressed together as a second 
video signal. The compression signals are processed 
with interleaving and are recorded on an optical disk 
191 together with the center shift amount 159. In this 
case, the second video signal, which represents a pic- 
ture obtained by sewing together two different quality 
pictures, is not desired to be output. Accordingly, a sec- 
ond video signal restriction information provision sec- 
tion 179 adds reproduction restriction information such 
as, for example, password protection to the second 
video signal stream. Then, the reproduction apparatus 
cannot reproduce the second video signal independ- 
ently. In this manner, it is prevented that the user views 
an abnormal picture of only the second video signal. In 
this case, a progressive reproduction apparatus repro- 
duces both the first and second video signals to realize 
a wide screen. 

[0099] When such an optical disk is reproduced by the 
reproduction apparatus in Figure 20, the second video 
signal is not independently output. From the optical 
disk, the center shift amount 159 is reproduced by a 
center shift amount reproduction section 159b. A wide 
picture synthesis section 173 uses the center shift 
amount 159 to synthesize a scope-size picture. The 3-2 
transform section 174 performs 3-2 pull-down transform 



shown in Figure 41 to transform a 24-frame/sec. signal 
of the movie into a 60-fields/sec. interlace signal or a 
60-frames/sec. progressive signal. As shown in Figure 
41, both the extension and wide picture synthesis are 
performed. The 3-2 transform performed by the 3-2 
transform section 174 is as follows. A synthesis picture 
179a having 24 frames/sec. is transformed into three 
interlace pictures 180a, 180b and 180c. A synthesis 
picture 179b is transformed into two interlace pictures 
180d and 180e. Thus, the picture having 24 frames/sec. 
is transformed into a 60-fields/sec. interlace picture. A 
progressive picture 1 81 can be output as three progres- 
sive pictures 181a, 181 b and 181c and two progressive 
pictures 1 81 d and 1 81 e. 

[01 00] Another method for dividing a screen is as fol- 
lows. As shown in Figure 40, a 1440x480 screen 154 is 
divided into two horizontal separation screens 190a and 
190b each having 720x480 pixels. Such division is per- 
formed by separating odd number of columns of pixels 
from even number columns of pixels by a picture hori- 
zontal division section 207. These screens 190a and 
190b are compressed as a first video signal and a sec- 
ond video signal in a similar manner to the above- 
described manner and recorded on the optical disk 1 91 . 
In order to avoid aliasing distortion, two pixels are 
added by a horizontal filter 206 shown in Figure 46 at a 
specific addition ratio, so that the high frequency com- 
ponent in the horizontal direction is attenuated. Such 
processing avoids generation of moire, which appears 
when the optical disk is reproduced by an existing repro- 
duction apparatus at 720 dots. 
[01 01 ] When the optical disk 1 91 is reproduced by the 
reproduction apparatus 65 shown in Figure 20, the hor- 
izontal separation screens 1 90a and 190b are decoded. 
When the decoded signals are synthesized by the wide 
picture synthesis section 173, an original 1440x480- 
pixel screen 154a is obtained. In the case of movies, 3- 
2 transform is performed by synthesizing the screen 
1 54a as shown in Figure 41 . 

[01 02] The second method of horizontally dividing the 
screen is advantageous in providing a level of high com- 
patibility for the following reason. The first video signal 
and the second video signal both represent an ordinary 
720x480-pixel picture obtained by dividing the original 
1 440x480-pixel picture into two by a horizontal line. 
Accordingly, even when the second video signal is erro- 
neously reproduced by an ordinary reproduction appa- 
ratus such as a DVD player, the resultant picture has the 
same aspect ratio as that of the original picture. Such a 
division system advantageously realizes reproduction 
of an interlace picture by an ordinary reproduction 
apparatus, reproduction of a 525 progressive picture by 
a progressive reproduction apparatus, and reproduction 
of a wide screen picture having a scope of, for example, 
720P by a 720P high resolution reproduction apparatus. 
Such advantages are conspicuous in the case of mov- 
ies, which can be reproduced at the rate of 2X. 
[01 03] This method is applied as shown in Figure 44. 
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A 1440x960 progressive picture 182a is divided in hori- 
zontal and vertical directions by a horizontal and vertical 
division section 194 of a picture division section 115 
using, for example, sub-band filter or wavelet transform. 
Then, a 525 progressive picture 183 is obtained. This is 5 
divided into interlace signals 184 and recorded as a 
stream 188a. 

[0104] Interpolation information 185 is divided into 
four streams 188c, 188d, 188e and 188f in a similar 
manner and recorded in units of an interleave block. 
The maximum transfer rate of each interleave block is 8 
Mbps by the DVD format. When the interpolation infor- 
mation 185 is divided into four streams, the transfer rate 
of 32 Mbps is obtained. In the case of six angles, the 
transfer rate of 48 Mbps is obtained. Thus, 720P and 
1050P HDTV pictures can be recorded. In a conven- 
tional reproduction apparatus, a stream 188a is repro- 
duced and an interlace picture 184 is output. Regarding 
the streams 188c, 188d, 188e and 188f, output restric- 
tion information is recorded on an optical disk 187 by a 
picture processing restriction information generation 
section 179. Therefore, an ugly picture of interpolation 
information 185 such as differential information or the 
like is not output in error. An optical disk compatible with 
HDTV and NTSC is realized by dividing a signal in a 
horizontal direction by the system shown in Figure 44. 
[0105] In Figure 20, an interlace signal is obtained by 
the transform performed by the interlace transform sec- 
tion 175, and as a result, a scope-size screen 178 is 
obtained. A 525P progressive signal is also output on a 
scope-size screen in a similar manner. When viewed by 
a 720P monitor, a 525P signal is transformed into a 
720P progressive signal by a 525P/720P transform sec- 
tion 176, as a result of which a letter box-type 720P 
screen 177 having 1280x720 or 1440x720 pixels (pic- 
ture has 1280x480 or 1440x480 pixels) is output. A 
scope-size picture (2.35:1) has 1 128x480 pixels. A pic- 
ture having a similar aspect ratio to this is obtained. A 
movie signal has 24 frames/sec. Therefore, the transfer 
rate of the progressive picture is 4 Mbps. When the 
scope-size picture is recorded by the 2-screen system 
according to the present invention, the transfer rate is 8 
Mbps. Since a two-layer DVD can store data for about 2 
hours and 15 minutes, a 720P or 525P high definition 
progressive picture can be recorded on one optical disk. 
Such data is output on a conventional TV as an inter- 
lace signal, needless to say. As described above, the 
scope-size (2.33:1) picture of the movie can be output 
as a 525P or 720P picture. 

[0106] Hereinafter, a specific method for recording 
and reproducing a 1050 interlace signal will be 
described. An even field 208a of a 1050 interlace signal 
is divided into two pictures 208b and 208c by horizontal 
division means 209. Two pictures 208b and 208c are 
respectively divided by vertical division means 210a 
and 210b to obtain pictures 208d and 208e, and 208f 
and 208g. An odd field 21 1a is divided in a similar man- 
ner to obtain pictures 21 1 d, 21 1 e, 21 1 1 and 21 1 g . In this 



case, the pictures 208d and 21 1d act as main signals 
and an interlace picture is output by an existing repro- 
duction apparatus. Horizontal fitters 206b and 206c and 
vertical filters 212a and 212b, inserted for preventing 
interlace interference and the like, reduce aliasing dis- 
tortion of the reproduced picture. 
[0107] With reference to Figures 27, 28, 42 and 49, 
the file structure and identifiers for pictures will be 
described. Figure 27 shows a logical format of DVD. 
Each logical block includes a video file. As shown in Fig- 
ure 28, a minimum unit of a system stream is referred to 
as a "ceir. In a cell, picture data, audio data and sub 
picture are recorded in a packet in units of 1 GOP. 
[01 08] A ceil 21 6 (see Figure 1 8) of a main signal of a 
first stream has a packet 21 7. A provider defined stream 
in the packet 21 7 has a capacity of 2048 bytes. The pro- 
vider defined stream includes a progressive identifier 
218 indicating whether the signal is progressive or inter- 
lace, a resolution identifier 219 indicating whether the 
resolution is 525, 720 or 1050, a differential identifier 
220 indicating whether or not the interpolation signal is 
a differential signal from the main signal, a filter identi- 
fier (described later), and sub stream number informa- 
tion 221 indicating the stream number of a first sub 
stream. 

[01 09] With reference to Figure 52, a process for per- 
forming reproduction using a picture identifier 222 will 
be described. 

[0110] From the optical disk, reproduction process 
control information 225 is first read from management 
information 224. Since the information 225 includes 
restriction information on VOB, a 0th VOB 226a is only 
connected to a first VOB 226b having a main picture in 
an existing reproduction apparatus. Since the 0th VOB 
226a is not connected to a second VOB 226c having an 
interpolation signal such as differential information, an 
ugly picture such as differential information is not output 
by the existing reproduction apparatus. Each VOB of the 
main signal has a picture identifier. Since the progres- 
sive idenfrfier= 1 and resolution identrf ier=00 (525) in the 
first VOB 226b and the second VOB 226c, a progres- 
sive signal having 525 scanning lines is reproduced 
from a progressive or high definition HD reproduction 
apparatus. 

[01 1 1] In a picture identifier 222 of the next VOB 226d, 
the progressive identrf ier=o and the resolution identifier 
219=10. An interlace signal having 1050 scanning lines 
is output. VOBs 226e, 226f and 226g are interpolation 
information. Thus, an NTSC signal is output by a con- 
ventional reproduction apparatus, an interlace signal 
having 720 horizontal pixels and 1050 vertical pixels is 
output by a progressive reproduction apparatus, and a 
full HDTV-format signal having 1050 scanning lines is 
output by a high definition reproduction apparatus. The 
picture identifier 222 can be recorded in the manage- 
ment information 224. 

[0112] With reference to Figure 53, the relationship 
among VPTS (video presentation time stamp) of the 
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sub track of interleave blocks, i.e. , decoding output time, 
will be described. In the first VOB 226b as the main sig- 
nal, interleave blocks 227a, 227b and 227c are 
recorded together with VPTS1. VPTS2 and VPTS3. In 
the second VOB 226c. interleave blocks 227d, 227e 
and 227f are recorded together with VPTS1. VPTS2 
and VPTS3. A conventional player reproduces the inter- 
leave blocks 227a, 227b and 227c at 1X. Since the 
main signal includes an audio signal, the audio signal is 
also reproduced. A progressive player first reproduces 
the interleave block 227d of the second VOB 226c as a 
sub signal and stores the block in a buffer memory. After 
the storage, the progressive player reproduces the inter- 
leave block 227a of the first VOB 226b. The audio and 
video signals are synchronized with the synchronization 
information of the interleave block 227a. Since the audio 
signal is included in the main signal, the main signal and 
the sub signal shown in parts (2) and (3) of Figure 53 
are output in synchronization with the audio signal. In 
this case, a track jump is performed between the inter- 
leave blocks 227a and 227e. 

[01 1 3] Thus, a progressive signal shown in part (4) of 
Figure 53 is output. By checking the VPTS of the inter- 
leave blocks by the reproduction apparatus, the main 
signal and the sub signal are decoded in synchroniza- 
tion and synthesized, thereby obtaining a normal pro- 
gressive signal. 

[01 1 4] Figure 54 shows an arrangement of signals in 
a simultaneous cast system by which an NTSC signal 
and an HDTV signal are recorded as interleave blocks 
independently at the same time. In the VOB 227a as the 
main signal, a video signal and an audio signal 232 are 
recorded. In the VOBs 227b and 227c, an HDTV com- 
pression video signal corresponding to about 16 Mbps 
is recorded, 8 Mbps for each, by the interleave system. 
A conventional player and a progressive player shown in 
parts (1) and (2) of Figure 54 reproduces an NTSC 
(525i) signal. An HDTV player shown in part (3) of Fig- 
ure 54 reproduces a 1 6 Mbps HDTV signal as a result of 
obtaining only audio data from the first VOB 227a, 
reproducing a first sub picture and a second sub picture 
from the VOBs 227b and 227c, and synthesizing these 
data. Since the reproduction of the sub signals is 
restricted by the reproduction process control informa- 
tion 225, an existing DVD player does not reproduce an 
HDTV compression signal even when the user errone- 
ously operates the player. Thus, an NTSC signal is out- 
put by the existing player, and an HPTV signal is output 
by the HPTV player. Figure 55 is a block diagram of a 
reproduction apparatus. The operation of the reproduc- 
tion apparatus is not described in detail since it is similar 
to the operations described above. A reproduction sig- 
nal from the optical disk is divided by an interleave block 
division section 233. A main signal is decoded by an 
audio decoder 230 of an NTSC decoder 229, and a first 
sub signal and a second sub signal which are each an 8 
Mbps stream, are decoded by an HDTV decoder 231. 
Thus, an HDTV signal and an audio signal are output. 



The data in the optical disk is reproduced as an NTSC 
signal even by a conventional reproduction apparatus 
by simultaneous casting. Moreover, according to the 
present invention, a transfer rate of 16 Mbps is obtained 

5 when two interleave streams are used. Accordingly, a 
standard HDTV MPEG-compression signal is recorded 
as it is. With a DVD, a transfer of only 16 Mbps is 
obtained with two interleave blocks. Since an HDTV 
compression video signal is a 16 Mbps signal, audio 

10 data cannot be recorded. According to the present 
invention, audio data of the NTSC signal of the main 
signal is used. Therefore, an audio signal can be 
recorded even when an HDTV signal is recorded with 
two interleave blocks. 

is [0115] Now, a method for removing interlace interfer- 
ence will be described. When a progressive signal is 
transformed into an interlace signal by removing unnec- 
essary components, aliasing distortion is generated and 
thus a moire of a low frequency component is gener- 

20 ated. A 30 Hz line flicker is also generated. In order to 
avoid these inconveniences, the signal needs to be 
passed through interlace interference removal means. 
Interlace interference removal means 140 is added to a 
progressive signal section of a progressive/interlace 

25 transform section 1 39 of the recording apparatus in Fig- 
ure 22 (described above). When a progressive signal is 
input, the interlace interference removal means 140a 
detects a video signal having a high probability of being 
interfered with from the input progressive signal, and 

30 passes only such a video signal through an interlace 
interference removal filter 141 . For example, in the case 
of a picture having a low vertical frequency component, 
interlace interference does not occur. In such a case, 
the filter is bypassed by a filter bypass route 143. Such 

35 an operation alleviates the deterioration in the vertical 
resolution of the picture. The interlace interference 
removal filter 141 includes a vertical filter 142. 
[0116] In part (a) of Figure 46 (time and space fre- 
quency diagram), the hatched area represents an alias- 

40 ing distortion generation area 21 3. 

[01 1 7] The aliasing distortion generation area 21 3 can 
be removed by a vertical filter. Specifically, as shown in 
part (c) of Figure 46, three line memories 195 are pro- 
vided. Regarding a progressive signal having 480 lines, 

45 picture information on the target line (n'th line) and pic- 
ture information on the immediately previous and sub- 
sequent lines ((n-1)th line and (n+1)th line) are added 
together by an adder 196. Thus, information of one line 
is obtained, and 240 interlace signals are generated. 

50 Such processing filters the information in a vertical 
direction, resulting in alleviation in the interlace interfer- 
ence. By changing the adding ratio of the three lines, fil- 
ter characteristics can be changed. This is referred to as 
a "vertical three-line tap filter". By changing the adding 

55 ratio of the center line with respect to the immediately 
previous and subsequent lines, a simpler vertical filter 
can be obtained. As shown in part (d) of Figure 46, line 
information can be processed with a vertical filter after. 
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for example, the (n-1)th line of the previous frame and 
the (n+l)th line of the subsequent frame (even lines) are 
developed on an identical space, in lieu of a simple ver- 
tical filter. Such a time vertical filter 214 has an effect of 
alleviating interlace interference, which occurs when a 
progressive signal on the optical disk is reproduced by a 
non-progressive player and only an interlace signal is 
listened. A horizontal filter 206a is realized by adding 
two pixels in a horizontal direction to synthesize one 
pixel. Needless to say, however, such a filter deterio- 
rates the resolution of the progressive picture. The filter 
effect is alleviated by preventing filtering on a picture 
having a low probability of being interfered with or by 
changing the adding ratio to realize a vertical filter. 
When the filter effect is weakened, the deterioration in 
the resolution of the progressive picture is alleviated. A 
progressive reproduction apparatus according to the 
present invention filters the information sufficiently to 
remove interlace interference during reproduction, so 
that it is not necessary to filter the information when 
being recorded. When such progressive reproduction 
apparatuses replace the existing reproduction appara- 
tuses in the future, filtering during recording will not be 
necessary. In such a case, there will be both filtered 
optical disks and unfiltered optical disks. The interlace 
interference removal means 140 outputs an interlace 
interference removal identifier 144 to check whether or 
not the picture has been filtered and records the infor- 
mation on the optical disk 85 by recording means 9. 
[0118] With reference to Figure 50, a specific method 
for recording a filter identifier will be described. A filter 
identifier 144 is put in a header in 1 GOP, which is an 
MPEG recording unit in one stream. "00" indicates that 
the signal is not filtered. "10" indicates that the signal 
has been passed through a vertical filter. "01" indicates 
that the signal has been passed through a horizontal fil- 
ter. "11" indicates that the signal has been passed 
through a vertical and a horizontal filter. Since the filter 
identifier 144 is put in the minimum unit of 1 GOP, the fil- 
ter can be turned on or off in units of 1 GOP in the repro- 
duction apparatus. Accordingly, deterioration of the 
picture quality by double filtering is avoided. 
[01 1 9] With reference to parts (a) and (b) of Figure 32, 
an operation of a reproduction apparatus 86a for repro- 
ducing an optical disk 85 will be described. As in Figure 
21 , two interlace pictures 84a and 84b are reproduced 
to synthesize a progressive picture 93a. Notably, when 
the interlace interference removal filtering identifier 144 
is "ON" or when special reproduction such as "slow" or 
"still picture" is not performed and a progressive picture 
is not output either, an interlace signal is output directly 
by an interlace output section at 1X. This is energy effi- 
cient. 

[0120] When special reproduction is performed or 
when the interlace interference removal filtering identi- 
fier 144 is off, a "2X" instruction 146 is sent from a con- 
trol section 147 to a motor rotation speed alteration 
section 35. Then, the optical disk 85 rotates at 2X, and 



a progressive picture is reproduced. 
[0121] A method for removing interlace interference 
when the progressive picture reproduced in this manner 
is output to an interlace TV 148 as an interlace signal 

5 will be described. When the interlace interference 
removal filtering identifier 144 is off, a determination 
switch circuit 149 is switched to pass the progressive 
signal through the interlace interference removal filter- 
ing identifier 144. Then, two frames 93a and 93b are 

w transformed by an interlace transform section 139 into 
odd and even interlace signals 72a and 73a. Thus, an 
ordinary interlace signal is output. In this case, a picture 
with no interlace interference is displayed on the inter- 
lace TV 148. Since the interlace interference removal fil- 

75 ter does not influence the interlace signal significantly, 
the interlace signal is not deteriorated. A progressive 
signal with no interlace interference removal filter is out- 
put to a progressive signal output section 215. By the 
system of turning on and off the interlace interference 

20 removal filter by the reproduction apparatus, a progres- 
sive picture with no quality deterioration and an inter- 
lace picture with no quality deterioration such as 
interlace interference are both obtained. 
[0122] When slow reproduction of a speed of 1/2 or 

25 less and still picture reproduction is performed, the 
removing filter is weakened since the interlace interfer- 
ence is alleviated. 

[01 23] Next, a method for improving special reproduc- 
tion will be described. When an instruction to perform a 

30 slow or still picture reproduction is issued from the con- 
trol section 147 through an operation input section 150 
to slow/still picture reproduction means 151, the inter- 
lace transform section 149 divides the 480 lines of the 
frame 93a into two fields using a frame processing sec- 

35 tion 152 to create and output an odd interlace signal 
72b and an even interlace signal 73b. Then, a low or still 
interlace picture having a resolution of 480 with no blur- 
ring is displayed on the interlace TV 1 48. In a conven- 
tional interlace reproduction apparatus, the resolution 

40 needs to be lowered to 240 in order to obtain a slow or 
still picture with no blurring. According to the present 
invention, a slow or still picture having a resolution of 
480 with no blurring is obtained by transforming the 
interlace signal into a progressive signal once and then 

45 transforming the progressive signal back to the interlace 
signal. Figure 32 illustrates this process in the flowchart 
in part (a) (steps 153a through 153g). The detailed 
description of the flowchart is omitted. 
[0124] With reference to Figure 26. a method for out- 

so putting streams in two channels continuously will be 
described. The two-channel streams are recorded on 
an optical disk as pictures in cameras 1 and 2 by an 
interleave system. A first stream from the disk is repro- 
duced and then switched to a second stream. 

55 [0125] With reference to Figure 35, a method for 
switching a specific stream to another stream smoothly 
with no disconnection when the contents of the optical 
disk include a plurality of streams, i.e., when a plurality 
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of streams are multiplexed will be described. As shown 
in part (1) of Figure 35, an optical disk 106 includes two 
different streams as a first stream 111 of a first video 
signal and a second stream 112 of a second video sig- 
nal. The two streams are basically recorded substan- 5 
tially at the same radius. 

[0126] Usually, only the first video signal as a basic 
stream is reproduced. Accordingly, a first stream 111a is 
reproduced and then a first stream 1 1 1 b is continuously 
reproduced. When the user issues an instruction to 
switch the first video signal to the second video signal 
from an instruction input section 19 in Figure 5 at time 
t=tc, a tracking control circuit 22 in Figure 5 is used to 
access a track at a different radial position, thereby out- 
putting a second stream 112b of the second video sig- 
nal at time t=tc. 

[01 27] Thus, as shown in part (2) of Figure 35, the first 
video signal is switched to the second video signal 
seamlessly with no disconnection at time t=tc in terms 
of the video, audio and sub picture signals. 
[0128] A method for realizing such a seamless repro- 
duction by synchronizing the video, audio and sub pic- 
ture signals will be described later. 
[0129] With reference to a timing diagram of parts (3) 
and (4) of Figure 35, a specific method for reproducing 
data will be described. As described with reference to 
the block diagram of Figure 22, a progressive picture as 
the first video signal is divided into main interlace video 
signals A1 through An (Odd First) and sub interlace 
video signals B1 through Bn (Even First). The signals 
are recorded separately in first-angle and second-angle 
sub channels. Although not described with reference to 
Figure 22, a progressive picture as the second video 
signal is also divided into main interlace video signals 
C1 through Cn and sub interlace video signals D1 
through Dn. The signals are recorded separately in 
third-angle and fourth-angle sub channels as shown in 
part (3) of Figure 35. Part (3) of Figure 35 is a timing dia- 
gram of the principle shown in Figure 36. The operation 
is the same. 

[01 30] Figure 36 puts a focus on an interleave section 
of the recording apparatus shown in Figure 22. A pro- 
gressive signal as the first video signal is divided by a 
first video signal division section 78a into a main signal 
(Odd First) and a sub signal (Even First). The amount of 
information can be reduced by finding a differential sig- 
nal between the main signal and the sub signal by a dif- 
ferential section 116a and compressing the main signal 
and the sub signal to be recorded on the disk. In the 
case of a progressive signal, the correlation between 
adjacent odd and even lines is quite strong, and accord- 
ingly the amount of information of a differential signal 
between the two lines is small. Thus, the amount of 
information to be recorded can be significantly reduced 
by finding the differential signal. 
[01 31 ] According to the present invention, the signals 
are recorded in a divided manner using the differential 
device 116a as shown in Figure 44. A 720P signal, i.e., 



a progressive picture having 720 lines or a 1 050P signal 
is divided by the picture division section 115 into 525 
basic information 187, progressive picture 183 (or 525 
interlace picture 184) and interpolation information 186. 
Differential information 185 between the basic informa- 
tion 187 and the interpolation information 186 is 
obtained by the differential device 1 1 6a. The differential 
information 185 is divided by a second video signal divi- 
sion section 78c and a third video signal division section 
78d into four streams 188c, 188d, 188e and 1881 
These streams are sent to a compression section 103 
and processed with interleaving by an interleave section 
113a. Thus, six streams are recorded in the angles on 
an optical disk 187. 

[01 32] At this point, the streams 1 88c, 1 88d. 1 88e and 
188f are differential information or interpolation informa- 
tion, and thus do not provide a normal picture when 
being decoded by the reproduction apparatus and out- 
put onto a TV screen. Such an abnormal picture makes 
the viewer feel uncomfortable. In order that the streams 
188c, 188d, 188e and 188f, including the interpolation 
information 186, recorded in different angles not be out- 
put by a non-progressive reproduction apparatus, 
restriction information is generated by the picture output 
restriction information generation section 179 and 
recorded on the optical disk 187. Specifically, such infor- 
mation prevents a specific stream from being opened 
without a password. Processing the streams 188c, 
188d, 188e and 188f with such password protection 
prevents a conventional reproduction apparatus from 
opening these streams and avoids the situation where 
the user views the abnormal picture obtained by decod- 
ing the interpolation information. 
[01 33] Returning to Figure 36, the first video signal is 
thus compressed, so that the main signal of the first 
video signal is divided into A1 and A2 interleave blocks 
83b and 83d, each including 1 GOP or more. The main 
signal of the second video signal is divided into C1 and 
C2 interleave blocks 83a. The sub signal of the second 
video signal is divided into B1 and B2 interleave blocks 
83e and 83g and D1 and D2 interleave blocks 83f and 
83h. As shown in Figure 36, a recording stream 117 is 
generated from these four pieces of data. In the record- 
ing stream 117, the blocks are arranged in the order of 
A1, B1, C1, D1, A2, B2, C2, and D2. The recording 
stream 1 17 is recorded on an optical disk 1 1 5 by record- 
ing means 145. A1, B1, A2 and B2 correspond to the 
first video signal of the progressive signal. Accordingly, 
the signals are recorded on the optical disk 115 in the 
order of the first video signal, the second video signal, 
the first video signal and the second video signal. A 
seamless reproduction performed by the AV synchroni- 
zation section will be described later. 
[01 34] In the above description, 1 GOP or more of the 
MPEG signal is recorded in each interleave block. Pre- 
cisely, one interleave block is restricted to about 0.5 
seconds or less. Therefore, only 30 fields of a video sig- 
nal can be recorded at the maximum. Accordingly, only 
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30 GOPs can be recorded in one interleave block at the 
maximum. One interleave block of the present invention 
is limited to 1 GOP or more and 30 GOP or less. 
[0135] A method for compression will be described. 
Interlace signals 79a and 80a of a first VOB 1 18 are put 5 
together as a field pair 125a and encoded by a frame 
encoding section 123a into a frame encoded signal 
127a. 

[0136] A dummy field 121 of a second VOB 1 19 is first 
encoded by a field encoding section 1 24b in a compres- 
sion section 82b on a field-by-field basis into a field 
encoded signal 129. Next, an even interlace signal 80b 
and an odd interlace signal 79b, which are sub signals, 
are put together as a first field pair 126a, frame- 
encoded by a frame encoding section 123b in the com- 
pression section 82b into a frame encoded signal 128a. 
[01 37] Thus, an Odd First dummy field is added to the 
second VOB 119. Thus, the second VOB signal 119 
starts with an odd interlace signal. Since the signals are 
recorded in the order of an odd interlace signal and then 
an even interlace signal, the signals are reproduced 
smoothly by a DVD player. In this case, one progressive 
signal corresponds to frame encoded signals 127a and 
1 28a. Due to the field encoded signal 1 29 obtained from 
the dummy field, there is an offset time period 130 of td 
between the frame encoded signal 127a from the main 
signal and the frame-encoded signal 128a from the sub 
signal. Accordingly, it is required to output the sub signal 
earlier by the offset time period when reproducing the 
progressive signal. 

[0138] With reference to Figure 34, the operation of 
the reproduction apparatus 86 described referring to 
Figure 21 will be described in more detail. A signal from 
the reproduction section 95 is divided into a first VOB 
118 as the main signal and a second VOB 119 as the 
sub signal. The first VOB 118 originally starts with an 
odd line and thus can be extended as it is. The second 
VOB 118 has a dummy field 1 29 at the start thereof for 
authoring. Reproduction of the second VOB 118 as it is 
results in generating an offset time period 119 of td 
between the main signal and the sub signal. Since it is 
time-consuming to synthesize the first progressive sig- 
nal in such a case, a picture corresponding one VOB 
and a picture corresponding the next VOB are not con- 
tinuous. In order to avoid this, the present invention pro- 
vides two method for skipping a dummy field 1 21 . 
[0139] According to a first method, a field encoded 
signal 129 at the start of the second VOB 119 is once 
input to an extension section 132. When progressive 
identification information is detected during or after field 
extension, a progressive processing switching section 
135 is switched to Yes. Thus, the dummy field 121 is 
skipped by dummy field bypassing means 1 32 so that 
an even interlace signal 80b is first output and then an 
odd interlace signal 79b is output. This signal is syn- 
chronized by synchronization means 133 with an audio 
signal 134 and a sub picture signal 135 such as subti- 
tles which are recorded in the main signal. As a result, 



progressive pictures 93a and 93b are output through a 
progressive transform section 90. In the embodiment 
where the dummy field 121 is bypassed in this manner, 
an odd field and an even field are output in synchroniza- 
tion with each other. Thus, a progressive signal, an 
audio signal and a sub picture signal with matching time 
axes are output. When progressive identification infor- 
mation is absent, the progressive switching section 135 
is switched to No, and thus the dummy field 121 is not 
bypassed. Progressive transform is not performed. 
Thus, an interlace signal 1 36 is output. Such an output 
of the interlace signal 1 36 occurs in a conventional DVD 
player without a progressive function. As described 
above, the dummy field bypassing means 132 is turned 
on for processing a progressive signal. Otherwise, the 
dummy field bypassing means 1 32 is turned off, so that 
an ordinary field encoded interlace signal is normally 
output without dropping the field. 
[0140] A second method is used when the dummy 
field 1 29 is field-encoded into 1 GOP frames and can be 
separated from the frames of the sub signal. Before 
decoding, the field encoded signal 129 obtained by 
encoding the dummy field is skipped by 1 GOP by 
dummy field encoded information bypassing means 
137. The skipped information is input to a buffer 131b, 
or skipping is performed when data is output from the 
buffer. To the extension section 88b, only the frames of 
the sub signal paired with the main signal or field infor- 
mation is input. Thus, by ordinary means described 
above referring to Figure 21 , the even interlace signal 
80 and the odd interlace signal 79b are extended, inter- 
lace-transformed, synchronized with the main signal, 
and transformed into progressive signals 93a and 93b 
by the progressive transform section 90. 
[0141] According to the second method, the dummy 
field is removed while the dummy field is in the form of 
the encoded information. Therefore, the dummy field is 
not required to be processed by the buffer section 131b 
or the extension section 88. This method is appropriate 
for putting a field encoded in units of 1 GOP to the start 
of the second VOB. 

[0142] According to the first method, the dummy field 
129 and the field signals in each frame 127a are field- 
encoded together to generate a unit of 1 GOP. This is 
efficient where a dummy field is inserted at the start of 
one interleave block in, for example, a seamless multi- 
ple angle system having a high recording efficiency. The 
first method has an effect of extending the recording 
time period. 

[0143] By skipping the dummy field 1 21 only for pro- 
gressive processing in this manner, progressive pic- 
tures can be reproduced with no disconnection at the 
border between adjacent VOBs or between interleave 
blocks in the case of a seamless multiple angle system. 
[0144] Such processing will be described with refer- 
ence to the flowchart in Figure 37. In step 138a, an 
instruction to start reproduction of (2n-1)th angle data is 
issued. In step 138b. whether or not a progressive iden- 
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Wier is present is checked, tf yes, the processing jumps 
to step 1381 If no, in step 1 38c, whether or not the fol- 
lowing three conditions are fulfilled is checked. Condi- 
tion 1 is that there is one field (or an odd number of 
pieces of fields) of GOP at the start of the nth angle 
VOB. Condition 2 is that one field of GOP is not existent 
continuous to one field of GOP. Condition 3 is that the 
leading GOP of the (2n-1)th angle does not correspond 
to one field. Then, in step 1 38d, whether or not the three 
conditions are fulfilled is checked. If no, in step 138e, 
interlace processing is performed to output only the (2n- 
1)th angle. If yes, in step 1381, the processing is 
switched to progressive processing. In step 138g, 
whether or not the reproduction is to be performed from 
the start of the (2n-1)th angle VOB is checked. If no, the 
processing jumps to step 138j. If yes, in step 138h, the 
n'th angle VOB is output while dropping the picture of 
the first one field or GOP corresponding to one field. 
When the (2n-1)th angle includes an audio signal, the 
VOB is output while skipping the first offset time period 
dt (default value: 1/60 sec.). In step 138], the main sig- 
nal of the (2n-1)th angle and the sub signal of the 2n'th 
angle are decoded, synchronized and synthesized into 
a progressive signal. In step 1 38k, a progressive picture 
is output. When a seamless multiple angle output is per- 
formed in step 138m, the processing advances to step 
138n, where each interleave block of the (2n-l)th angle 
(i.e., sub signal) is field-decoded, and the output is per- 
formed while the first block is skipped. Alternatively, the 
outputting order of the odd lines and the even lines is 
inverted at the time of interlace transform. In step 138p, 
the progressive picture is synthesized and output. 
[0145] Due to authoring, several seconds of dummy 
field is inserted at the start of the multiple angle VOB. 
The dummy field group at the start of the VOB is read. 
In a similar manner, the leading address at which the 
multiple angle VOB starts is read from the PGC data. 
For ordinary reproduction, data is read from the start of 
the VOB. For only 3D or progressive reproduction, the 
dummy field is skipped and the data is read from the 
starting address of the VOB corresponding to each of 
the multiple angle VOB. Thus, 3D or progressive pic- 
tures are prevented from being interrupted at the border 
of adjacent VOBs. 

[0146] So far, the MADM system has been described. 
Hereinafter, a provider defined stream picture division 
multiplex system (PSDM) as another system will be 
described. Figure 61 is a block diagram of the PSDM 
system of a vertical division system. Figure 62 is a block 
diagram of the PSDM system of a horizontal division 
system. Figure 63 shows a signal format of the PSDM 
system. 

[0147] As shown in Figure 63, a DVD video signal has 
10.08 Mbps. and a provider defined stream is defined 
separately from a basic stream. A sum signal described 
with reference to Figure 23 can be added to the basic 
stream and put into the provider defined stream. Such a 
signal can be reproduced by changing the circuit even 



with a normal 1X drive. According to the experiments 
performed by the present inventors, a satisfactory pro- 
gressive picture is obtained when the sum signal is 6 
Mbps and the difference signal is 3 Mbps. Thus, a satis- 
5 factory progressive picture is obtained unless the 
encoding is difficult. 

[0148] In the case of a movie, which contains a pro- 
gressive picture of 241 frames, a sufficient picture is 
obtained by the PSDM system. The system shown in 

10 Figure 61 is basically the same as those shown in Fig- 
ures 22 and 23. In the latter half of the production of the 
disk, a sum signal is recorded in the basic stream with a 
basic stream identifier being added thereto in an author- 
ing section, and a difference signal is recorded in a pro- 

15 vider defined stream with a provider defined stream 
identifier being added thereto. In the case of a movie, a 
3-2 transform identifier synchronized with the sum and 
difference signals is added. 

[0149] The reproduction apparatus decodes the sum 
20 signal from a packet provided with the basic stream 
identifier 267 by a first decoder 69a, and decodes the 
difference signal from a packet provided with the pro- 
vider defined stream identifier 268. Signals A and B are 
obtained by a sum calculation section 250 and a differ- 
25 ence calculation section 251. Thus, a 525P signal is 
synthesized. 

[0150] Figure 62 shows a system for dividing a wide 
525P signal in a horizontal direction and PSDM-record- 
ing the resultant signal as two interlace signals, like in 

30 Figure 58. 

[01 51 ] With reference to Figure 26 and part (3) of Fig- 
ure 35, a process for reproducing the optical disk 155 
and switching the first video signal to the second video 
signal at t=tc will be described. As shown in Figure 26, 

35 the optical disk 155 (provided as an example of an opti- 
cal medium) has four channel stream recorded by an 
interleave system. The streams are recorded in the 
order of A1 , B1 , C1 , D1 , A2, B2, C2, D2, A3, B3, C3 and 
D3 in interleave units of 1 GOP. Since the first video sig- 

40 nal is first output, interleave blocks (hereinafter, referred 
to simply as "I LB") 84a and 84b(i.e., A1 and B1) are 
continuously reproduced and a track jump 156 is per- 
formed, thus reproducing ILBs 84e and 84f (i.e., A2 and 
B2). When the first video signal is switched to the sec- 

45 ond video signal at t=tc, a track jump 1 57 is performed, 
thus reproducing ILBs 841 and 84h (i.e., C3 and D3). 
Thus, A1 , A2 and C3 as main signals and B1 , B2 and 
D3 as sub signals are reproduced, extended by the 
extension section, and sent through the synthesis sec- 

so tion 1 01 b to the output section 1 1 0b. The resultant sig- 
nal is synchronized with a sub picture signal from a sub 
picture decoder 1 59 and an audio signal from an audio 
signal reproduction section 160 by the AV synchroniza- 
tion section 158. Thus, these signals are output with 

55 matching timing. Accordingly, the progressive signal in 
the first stream and the progressive signal in the second 
stream are reproduced seamlessly with no disconnec- 
tion. A method for synchronization for providing a seam- 
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less reproduction will be described later. 
[0152] With reference to Figure 45, a method for syn- 
chronizing two picture signals and an audio signal when 
two streams are simultaneously reproduced as in the 
case of, for example, a 3D picture or scope picture will 5 
be described. When three or four streams are simulta- 
neously reproduced as in the case of a 720 P signal, a 
simitar method is usable and will not be described. 
[0153] First, a method for synchronizing two streams 
according to the present invention will be described. 
First, as shown in Figure 39, a system reproduced from 
the optical disk is once accumulated in a track buffer 23 
and then sent to a first video decoder 69d and a second 
video decoder 69c. In the track of the optical disk, a first 
stream A and a second stream of the progressive signal 
are alternately recorded on an interleave block-by-inter- 
leave block basis. 

[01 54] First, the stream A is reproduced at 2X rotation, 
and data accumulation in a first track buffer 23a of the 
track buffer 23 is started. As shown in part (1) of Figure 
45, when t=t1 to t2, data for 1 interleave block (I LB) 11 of 
the first video signal for 1 interleave time T1 is accumu- 
lated. A first track buffer data amount is increased, and 
becomes equal to 1 I LB at t=t2. Thus, data accumula- 
tion for 1 I LB of the first video signal is completed. At 
t=t2, after accumulation of data for 1 I LB of the first 
video signal corresponding to 1 GOP or more is com- 
pleted, the second video signal (stream B) is repro- 
duced from the optical disk starting from the interleave 
block 12. As shown in the solid line in part (4) of Figure 
45, data accumulation of the second video signal in a 
second track buffer 23b is started at t=t2 and continued 
until t=t6. From t=t2 through t8, as shown in parts (7) 
and (10) of Figure 45, the video presentation stamps 
(VPTS) of the first video signal and the second video 
signal are synchronized and respectively sent to the first 
video decoder 69c and the second video decoder 69d 
from the track buffer 23a and the track buffer 23b. As 
shown in parts(8) and (1 1) of Figure 45, the input sig- 
nals are output as two pieces of video data after being 
extended by the first and second video decoders 69c 
and 69d. The output of these pieces of data starts at 
t=t3, which is delayed by a video delay time period twd, 
which is required for MPEG extension of the data. From 
t=t4 through t10, the streams A and B are synthesized 
into a progressive signal by a progressive transform 
section 170. Thus, a progressive signal for one inter- 
leave block is output. 

[01 55] As described above, from t=t2 through t8, data 
for one interleave block is input to the decoders. Accord- 
ingly, the data in the first track buffer 23a and the data in 
the second track buffer 23b are consumed and reduced 
at substantially the same rate. Therefore, as shown in 
part (2) of Figure 45, the data amount in the first track 
buffer is reduced from t=t2 through t7. At t=t7, the data 
amount is 1/2 of 1 I LB. Since data reproduction for the 
interleave block 15 starts at t=t7, the data amount 
increases until t=t8. when the data amount reaches 1 



I LB. Since data input to the first decoder 69c starts at 
t=t8 as at t=t2, the data amount reduces until t=t11. 
Finally, the buffer memory amount becomes 1/2 ILB. 
[0156] With reference to part (4) of Figure 45, a 
change in the memory amount in the second track 
buffer 23b for stream B will be described. At t=t2. input 
of data B1 for the interleave block 12 of stream B in the 
second track buffer 23b starts. At the same time, trans- 
fer of data B1 to the second video decoder 69d starts. 
Accordingly, the buffer amount at t=t6 is 1/2 ILB. When 
2-angle recording of a progressive signal according to 
the present invention is performed, it is necessary to 
perform a track jump to the interleave block 15 over the 
interleave blocks 13 and 14 since there are four streams, 
i.e., four interleave blocks. During the jump period 197 
(tj), data input from the optical disk is interrupted. Thus, 
the buffer amount of the stream B is reduced until t=t8, 
when the buffer amount is close to zero. 
[01 57] Since input of data B2 of the interleave block 16 
starts at t=t8, the buffer amount starts increasing again. 
At t=t1 1 , the memory amount of the second track buffer 
is 1/2 ILB. At t=t1 1 , a track jump to the interleave block 
19 of A3 over the interleave blocks 17 and 18 is per- 
formed. 

[01 58] The above-described operation is repeated. 
[01 59] Now, the minimum necessary memory capac- 
ity for a track buffer 23 (total capacity of the first and sec- 
ond track buffers 23a and 23b) according to the system 
of the present invention will be checked. A track buffer 
capacity 1 98 indicated by dotted line in part (4) of Figure 
45 shows the total data amount in the first and second 
track buffers 23a and 23b. A continuous reproduction is 
realized by setting the total capacity of a minimum 1 ILB 
in the track buffer. 

[0160] According to the present invention, the total 
capacity of the track buffers 23a and 23b is set to be 1 
interleave block or more for progressive reproduction. 
Thus, overflow and underflow of the track buffer are pre- 
vented. A method for switching the system clock STC 
between two streams will be described with reference to 
Figure 31 . A progressive signal includes two streams A 
and B. Here, the streams of two interlace signals form- 
ing a 1 ILB progressive signal are referred to as A1 and 
B1 . As shown in part (1 ) of Figure 31 , data A1 for stream 
A is reproduced during the 1/2 ILB time period and all 
the data is recorded in the buffer. Then, as shown in part 
(2) of Figure 31 , data for stream B is reproduced as B1 
and stored in the buffer after A1 is reproduced. Since 
the data reproduced from the optical disk is restricted 
with stream B (part (2) of Figure 31) as described 
above, the track buffer does not overflow. Stream A 
(part (3) of Figure 31) or stream clock (SCR) from the 
track buffer for stream B is reset substantially in syn- 
chronization with the start J of the reproduction of 
stream B (part (2) of Figure 31). Since stream B is out- 
put at the speed of 2X, the stream clock is counted at 
the speed of 1X as shown in part (3) of Figure 31. i.e.. 
at half the speed of stream B due to the buffer. At point 
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G, the stream clock is reset. Time VPTS2 at which the 
video signal lor stream B is output needs to be synchro- 
nized with time VPTS1 in consideration of the delay time 
period Tvd due to, for example, MPEG decoding time 
period. In this case, at point I (t=Ti), when the VPTS 5 
stops rising, AV synchronization control is restarted. By 
checking VPTS2 of stream B and synchronizing VPTS1 
of stream A to VPTS2, synchronization is realized by 
one-system simple control. VPTS1 can be used addi- 
tionally. 

[01 61 ] Audio data of synchronizing stream B is repro- 
duced and the system clock is switched at point H using 
APTS of stream B as shown in part (4) of Figure 31 . 
Regarding a sub picture signal of stream B, the system 
clock can be switched in a similar manner. 
[0162] By using data of stream B with priority, AV syn- 
chronization is realized with simple control. 
[0163] All the data in streams. A1 and A2 is stored in 
the buffer memory, the buffer memory does not over- 
flow. Stream B1 may possibly overflow. However, 
according to the present invention, the synchronization 
control is performed using stream B and the system 
clock is switched to control the signal flow so that 
VPTS2 does not exceed the VPTS threshold level as 
shown in part (6) of Figure 31. Therefore, the buffer 
does not overflow. 

[0164] According to the present invention, the audio 
signal of stream B is used for audio reproduction. 
Therefore, the buffer amount of audio decoder is 
reduced to 1/2. Furthermore, by the system clock is 
switched at point H (t=Th) as shown in part (4) of Figure 
31. the audio signal is reproduced smoothly without 
exceeding the APTS threshold level. The sub picture 
information is also reproduced with smooth synchroni- 
zation. Accordingly, picture, audio and sub picture (sub- 
titles or the like) signals are synchronized, and picture 
and audio are reproduced seamlessly. The audio signal 
and the sub picture signals of stream A can be omitted. 
In the embodiment where the audio and sub picture sig- 
nals are put into stream B so that stream B2 is repro- 
duced by an existing reproduction apparatus, and 
reproduction of stream A is controlled by the second 
video signal output control information provision section 
179; a picture with no audio signal is prevented from 
being output. By omitting the audio and sub picture data 
of stream A, progressive picture software, for example, 
a 2-hour movie, can be recorded in one two-layer disk 
by the interleave block recording system according to 
the present invention. Such an effect will be described. 
In the case of a movie, data for about 2 hours and 15 
minutes can be recorded on a one-layer 4.7 GB DVD. In 
order to perform 2 -channel recording of a progressive 
picture without finding a differential, 9.4 GB is required. 
A picture signal requires 4 Mops, and sub picture and 
audio signals require almost 1 Mops. When the audio 
signal of 1 Mbps is recorded in one stream, a total of 
only 9 Mbps is sufficient. In other words, only 90% of the 
data amount, i.e., 8.5 GB (90% of 9.4 GB) is sufficient. 



Therefore, a two-layer disk accommodates the data for 
one layer and a progressive signal. 
[0165] The synchronization method of the present 
invention functions as follows. Where an interleave 
block of stream A is recorded first and then an interleave 
block of stream B is recorded on the optical disk, when 
the first data (e.g., stream A) is stored in a track buffer 
and the next data (e.g., stream B) is reproduced, the 
synchronization information of stream B is mainly used. 
Specifically, the system clock is switched so that the 
video time stamp of stream B (VPTS2) does not exceed 
the threshold value of VPTS2. In this manner, video and 
audio signals are reproduced in synchronization with 
each other with no disconnection. Stream A can be read 
from the buffer in synchronization with the time informa- 
tion such as VPTS2 (time stamp of stream B). Thus, the 
control is simple. 

[0166] As described above, according to the present 
invention, the first stream is once accumulated in a 
buffer and only the second stream is processed with 
synchronization. Thus, the control is accurate and sim- 
ple. Overflow and underflow can be prevented by setting 
the size of the buffer memory to be 1 I LB or more. 
[0167] An existing DVD reproduction apparatus uses 
a 100 to 300 kB buffer memories, which is about 1/5 of 
the standard 1 ILB. According to the present invention, 
smooth reproduction is performed with the standard 1 
ILB buffer memory. 1 ILB corresponds to 0.5 to 2 sec- 
onds. Since the wait time period in the case of multiple 
angle reproduction can be only about 1 second, 1 ILB is 
actually considered to correspond to 0.5 to 1 second. In 
order to handle an 8 Mbps stream corresponding to 1 
second, a buffer memory of 1 MB or more is usable in 
the reproduction apparatus according to the present 
invention. 

[01 68] The synchronization control section 1 66 in Fig- 
ure 30 can switch the system clock using the synchroni- 
zation data regarding the interleave blocks 12 and 16 of 
the second video signal to realize seamless reproduc- 
tion between interleave blocks. During data reproduc- 
tion for interleave blocks 12 and 16, the motor rotation 
speed reproduction track is controlled while monitoring 
the buffer amount of stream B. Thus, the memory 
amounts of the track buffers 23a and 23b can be opti- 
mized so as not to overflow. All the data for the inter- 
leave blocks 12 and 16 of stream A is in the track buffer 
23a and is not suitable to optimize the buffer size. When 
audio data of the interleave blocks 11 and 15 is used for 
reproduction, it is required to accumulate the one inter- 
leave block or more of audio data and sub picture data 
in the track buffer 23 (Figure 39) and the audio decoder 
buffer 172 (Figure 39) as shown in part (3) of Figure 45 
in order to match the time stamp of the audio data with 
the time stamp of the video output of parts (8) and (1 1) 
of Figure 45. By contrast, when the audio data of the 
interleave blocks 12 and 16 is used, 1/2 ILB data is suffi- 
cient as shown in part (5) of Figure 45. Accordingly, the 
required memory amount of the track buffer 23 (Figure 
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39) and the audio decoder buffer 172 (Figure 39) is 
reduced to half. 

[01 69] As shown in Figure 45. for reproducing data of 
interleave blocks 11 and 12 including the main signal of a 
progressive signal and data of interleave blocks 15 and 
16 including the interpolation of the progressive signal, 
the interleave blocks 15 and 16 can be stored in the 
buffer and then the motor rotation can be controlled 
based on the reproduction data regarding the interleave 
blocks 12 and 16. Thus, the memory amount of the buffer 
is reduced. The system clock of the AV synchronization 
control section 158 in Figure 30 can be switched based 
on the system clock of the interleave blocks 12 and 16. 
Thus, stable decoding is realized without causing the 
buffer to overflow. 

[01 70] The method of skipping the first field of a VOB 
of a progressive signal is described with reference to 
Figure 37. A second practical method is carried out with 
the recording apparatus 99 shown in Figure 22. Among 
an Odd First identifier 199 obtained by interlace trans- 
form and an Even First identifier 200, only the Even First 
identifier 200 is transformed by an Even/Odd transform 
section 201 into an Odd First identifier 202 and provided 
to each piece of MPEG data. Thus, all the VOBs start 
with an Odd First identifier. 

[01 71 ] As shown in Figure 21 , the reproduction appa- 
ratus reproduces the data regarding the Odd First iden- 
tifier 199 and the data regarding the Odd First identifier 
202 obtained from the Even First identifier. In step 203, 
it is checked whether or not a progressive signal is 
reproduced. If yes, in step 204, the Odd First identifier of 
the second video signal is transformed into an Even 
First identifier 200a and sent to the interlace transform 
section 71b of the MPEG decoder. If no. the identifier is 
not transformed. The interlace transform section 71b 
outputs the field of the frame picture of the second video 
signal first. Thus, an Even First picture is output. The 
synthesis section 90 synthesizes the Even First picture 
of the second video signal and the Odd First picture of 
the first video signal and outputs a normal progressive 
picture. By this method, all the interleave blocks start 
with an Odd First picture, and thus seamless multiple 
angles are reproduced with no problem by a DVD repro- 
duction apparatus. Since each interleave block is 
restricted to start with an Odd First picture for seamless 
multiple angle reproduction, the dummy field need not 
be inserted. Thus, the recording efficiency is not 
reduced. 

[0172] According to the second method of even/odd 
transform, the first video signal is normally reproduced 
even with an existing reproduction apparatus. However, 
when interlace transform is performed in accordance 
with the Odd First identifier of the second video signal 
by the existing reproduction apparatus, the odd field and 
the even field are inverted. Thus, a low quality picture 
with a lower resolution is output. In order to avoid this, 
when a conventional reproduction apparatus is used, 
information regarding the restriction on the reproduction 



of the second video signal by the DVD format is 
recorded on the optical disk 85 by the second video sig- 
nal output restriction information provision section 
described with reference to Figure 40. Thus, the second 
5 video signal is not reproduced by the existing reproduc- 
tion apparatus, and the situation where the user views 
unpleasant picture is avoided. 

[01 73] With the recording apparatus, an Odd First pic- 
ture (fie)d picture) and a transformed Odd First picture 

w (field picture), both of which are field pictures, are com- 
pressed respectively by compression sections 81a and 
81b by variable encoding. When motion detection and 
compensation are performed separately, encoding of a 
picture which is difficult to compress results in separate 

is block distortions. When such encoded signals are syn- 
thesized into a progressive signal, the decoded picture 
is deteriorated with noise. In order to avoid this, motion 
detection compensation is performed with an identical 
motion vector by one motion detection/compensation 

20 section 205 for encoding. Such processing matches the 
block distortion when the two fields are decoded. The 
matched block distortion is less conspicuous. Further- 
more, the load for encoding is reduced. 
[0174] Next, an operation of the AV synchronization 

25 section 1 58 will be described in detail. 

[0175] The AV synchronization section is one of the 
most important sections of the present invention. 
[01 76] First, an operation of a system control section 
in Figure 5 will be described. The system control section 

30 21 determines whether or not an optical disk has been 
set (inserted) in the reproduction apparatus. Once the 
optical disk is detected to be set, the system control 
section 21 controls a mechanism control section and a 
signal control section to control the disk rotation until 

35 stable reading is performed. When the stable reading is 
performed, the optical pickup is moved to read a volume 
information file shown in Figure 28. 
[0177] The system control section 21 further repro- 
duces a program chain group for a volume menu in 

40 accordance with volume menu management informa- 
tion in the volume information file shown in Figure 28. 
When the program chain group for the volume menu is 
reproduced, the user can designate data numbers of 
desired audio data and sub picture data. Reproduction 

45 of the program chain group for the volume menu during 
the reproduction of the data on the optical disk can be 
omitted when it is not necessary for the specific use of 
the multi-media data. 

[01 78] The system control section 21 reproduces and 
so displays a program chain group for a title menu in 
accordance with title group management information in 
the volume information file. Thus.the system control 
section 21 reads the file management information of the 
video file including the title selected based on the user's 
55 selection and is directed to the program chain at the 
start of the title. The program chain group is repro- 
duced. 

[0179] Figure 29 is the flowchart showing a detailed 
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process of reproduction of the program chain group per- 
formed by the system control section 21 . As shown in 
Figure 29, in steps 235a, 235b and 235c. the system 
control section 21 reads corresponding program chain 
information from the volume information file or a pro- 5 
gram chain information table of the video file. When the 
program chain is not completed in step 235d, the 
processing advances to step 235e. 
[0180] In step 235e. it is determined whether or not 
the current cell and the immediately previous cell should 
be connected seamlessly referring to seamless connec- 
tion instruction information for the cell to be transferred 
next in the program chain information. If yes, the 
processing goes to step 235f for seamless connection 
processing. If no, ordinary connection is performed. 
[0181] In step 235f. the mechanism control section 
and the signal processing section, for example, are con- 
trolled to read DSI packets, so that VOB reproduction 
end time (VOB_E_PTM) in the DSI packet of the cell 
which has been transferred and VOB reproduction start 
time (VOB_S_PTM) in the DSI packet of the cell to be 
transferred next are read. 

[0182] In step 235h, "VOB reproduction end time 
(VOB_E_PTM) - VOB reproduction start time 
(VOB_S_PTM)" is found. The resultant value is sent to 
the STC offset synthesis section 164 in the AV synchro- 
nization control section 1 58 in Figure 30 as an STC off- 
set value between the current cell and the immediately 
previous cell which has been transferred. 
[0183] Simultaneously, in step 235i, VOB reproduction 
end time (VOB_E_PTM) is transferred to an STC switch 
timing control section 166 as switching time T4 for an 
STC switch 162e. 

[0184] The system control section 21 then instructs 
the mechanism control section to continue reading data 
until the terminal position of the current cell. Thus, the 
data for the current cell is transferred to the track buffer 
23 in step 235j. Upon completion of the transfer, the 
program chain information is read in step 235c. 
[0185] If it is determined a seamless connection is not 
necessary in step 235e, the data is transferred to the 
track buffer 23 until the end of the system stream, and 
then program chain information is read in step 235c. 
[0186] Hereinafter, two examples of a method for AV 
synchronization control for seamless connection and 
seamless reproduction will be described. In other 
words, the AV synchronization control section 158 
shown in Figures 26 and 39 will be described in detail. 
[0187] Referring to Figure 39, a system decoder 161 , 
an audio decoder 160, video decoders 69c and 69d, 
and a sub picture decoder 1 59 are all synchronized to a 
system time clock given by the AV synchronization con- 
trol section in Figure 30 to process the data in the sys- 
tem stream. 

[0188] Regarding a first method, the AV synchroniza- 
tion control section 158 will be described with reference 
to Figure 30. 

[0189] In Figure 30, the AV synchronization control 



section includes STC switches 162a, 162b, 162c and 
162d, an STC 163, an STC offset synthesis section 
164, an STC setting section 165 and an STC switch tim- 
ing control section 166. 

[01 90] The STC switches 1 62a, 1 62b. 1 62c, 1 62d and 
162e switch between an output value of the STC 163 
and an output value of the STC offset value synthesis 
section 1 64 as a reference clock to be provided to the 
system decoder 161, the audio decoder 160, the main 
video decoder 69c, the sub video decoder 69d and the 
sub picture decoder 159, respectively. 
[0191] The STC 163 is a reference clock of the entire 
MPEG decoder shown in Figure 39 in ordinary repro- 
duction. 

[0192] The STC offset synthesis section 164 contin- 
ues outputting a value obtained by subtracting the STC 
offset value provided by the system control section from 
the value of the STC 163. 

[01 93] The STC setting section 1 65 sets an STC initial 
value given by the system control section or an STC off- 
set synthesis value given by the STC offset synthesis 
section 164 in the STC 163 at the timing given by the 
STC switch timing control section 166. 
[01 94] The STC switch timing control section 1 66 con- 
trols the STC switches 162a through 162e and the STC 
setting section 165 based on STC switch timing infor- 
mation given by the system control section, the STC 
163, and the STC offset synthesis value given by the 
STC offset synthesis section 1 64. 
[01 95] The STC offset value is an offset value used for 
changing the STC value when system stream #1 and 
system stream #2 having different STC initial values are 
continuously reproduced. 

[01 96] The STC offset value is specifically obtained by 
subtracting the "VOB reproduction start time 
(VOB_S_PTM)" described in the DSI of system stream 
#2 to be reproduced next from the "VOB reproduction 
end time (VOB_E_PTM) M described in the DSI of sys- 
tem stream #1 reproduced first. The information regard- 
ing the display of such a value is pre-calculated by 
reading data from the optical disk in Figure 5 by the sys- 
tem control section 1 67 when the data is input to the 
track buffer 23. 

[0197] The calculated offset value is supplied to the 
STC offset synthesis section 164 before the last pack of 
system stream #1 is input to the system decoder 161 . 
[0198] Except for seamless connection control, the 
data decoding processing section 165 in Figure 5 oper- 
ates as an MPEG decoder. The STC offset value given 
by the system control section 21 is 0 or an arbitrary 
value. The STC switches 162a through 162e always is 
selected to be connected to the STC 163. 
[01 99] With reference to Figure 38, switching of the 
STC switches 162a through 162e in the connection part 
of the system control section and an operation of the 
STC 163 when two system streams having non-contin- 
uous STC values, such as system streams #1 and #2, 
are continuously input to the system decoder 1 61 will be 



15 



20 



25 



30 



35 



40 



45 



50 



26 



51 



EP 0 944 269 A1 



52 



described. 

[0200] The SCR, APTS, VPTS and VDTS of the sys- 
tem streams #1 and #2 to be input will not be described. 
[0201] In the STC 163, an initial STC value corre- 
sponding to system stream #1 which is being repro- s 
duced is set by the STC setting section 165, and the 
value is sequentially counted up in accordance with the 
reproduction. The system control section 167 (Figure 5) 
calculates the STC offset value by the above-described 
method and sets this value in the STC offset synthesis 
section 164 before the last pack of system stream #1 is 
input to the decoder buffer. The STC offset synthesis 
section 164 continues outputting a value obtained by 
subtracting the STC offset value from the value of the 
STC offset 163. 

[0202] The STC switch timing control section 166 
obtains time T1 , at which the last pack of system stream 
#1 reproduced first is input to the decoder buffer, and 
switches the STC switch 162a to the output side of the 
STC offset synthesis section 164 at time T1 (step 
168b). 

[0203] Thereafter, the STC value referred to by the 
system decoder 161 is provided with an output from the 
STC offset synthesis section 164. The transfer timing of 
system stream #2 to the system decoder 161 is deter- 
mined by the SCR described in the pack header of sys- 
tem stream #2. 

[0204] Next, the STC switch timing section 166 
obtains time T2, at which the reproduction of the last 
audio frame of system stream #2 is terminated, and 
switches the STC switch 162b to the output side of the 
STC offset synthesis section 1 64 at time T2 (step 1 68c) 
at time T2. A method for obtaining time T2 will be 
described later. 

[0205] Thereafter, the STC value referred to by the 
audio decoder 160 is provided with an output from the 
STC offset synthesis section 164. The output timing of 
system stream #2 is determined by the APTS described 
in the audio packet of system stream #2. 
[0206] Next, the STC switch timing section 166 
obtains time T3 and T3\ at which the decoding of the 
last video frame of the main signal and the sub signal of 
system stream #1 reproduced first is terminated, and 
switches the STC switches 162c and 162d to the output 
side of the STC offset synthesis section 164 at time T3 
and T3* (step 1 68d). A method for obtaining time T3 will 
be described later. Thereafter, the STC value referred to 
by the video decoders 69c and 69d is provided with an 
output from the STC offset synthesis section 164. The 
video decoding timing of system stream #2 is deter- 
mined by the VPTS described in the video packet of 
system stream #2. Next, the STC switch timing section 
1 66 obtains time T4, at which the reproduction output of 
the last video frame of system stream #1 reproduced 
first is terminated, and switches the STC switch 162e to 
the output side of the STC offset synthesis section 164 
at time T4 (step 168e). A method for obtaining time T4 
will be described later. 



[0207] Thereafter, the STC value referred to by the 
video output switch 169 and the sub picture decoder 
159 is provided with an output from the STC offset syn- 
thesis section 164. The video output timing and sub pic- 
ture output timing of system stream #2 are determined 
by the VPTS and SPTS described in the video packet 
and the sub picture packet of system stream #2. 
[0208] When switching of the STC switches 162a 
through 1 62e is completed, the STC setting section 165 
sets the value given by the STC offset synthesis section 
164 in the STC 163 (step 168f) (referred to as "reload- 
ing of the STC 163) and switches all the switches 162a 
through 162e to be connected to the STC 163 (step 
168g). 

[0209] Thereafter, the STC value referred to by the 
audio decoder 160, the video decoders 69c and 69d, 
the video output switch 169 and the sub picture decoder 
159 is provided with an output from the STC 163, and 
the operation returns to the ordinary operation. 
[021 0] Now, two means for obtaining time T1 through 
T4 for switching the STC will be described. 
[0211] According to first means, information repre- 
senting time T1 through T4, which can be easily calcu- 
lated when the streams are created, is recorded on the 
disk The system control section 21 reads the informa- 
tion and sends the information to the STC switch timing 
control section 166. 

[021 2] Especially as T4, "VOB reproduction end time 
(VOB_E_PTM)" described in the DSI is used as it is. 
[021 3] On the disk the value obtained based on the 
STC value used in system stream #1 reproduced first is 
described, and the STC switch timing control section 
166 switches the STC switches 162a through 162e at 
the moment the value of the STC 163 becomes time T1 
through T4. 

[021 4] According to second means, based on the tim- 
ing when the leading data of system stream #1 is written 
in the track buffer 23, the video decoder buffers 1 71 and 
171a, and the audio decoder buffer 172, the time for 
reading the leading data is obtained. 
[0215] Assuming that the track buffer 23 is a ring 
buffer including a writing pointer, a reading pointer and 
a data memory, the system control section 21 specifi- 
cally reads an address indicated by the writing pointer 
and an address indicated by the reading pointer. Based 
on an address indicated by the writing pointer and an 
address indicated by the reading pointer when a target 
pack is written, the system control section 21 detects 
the moment when the pack written immediately before 
is read. 

[0216] When reproduction of system stream #1 is 
completed and reproduction of system stream #2 is 
started, the system control section 21 indicates the 
leading address of system stream #2 on the optical disk 
for reading. Accordingly, the system control section 21 
learns the moment when the leading data of system 
stream #2 is stored in the track buffer 23. Next, time T1 
is obtained by marking the address where the leading 
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pack of system stream #2 is written and setting the 
moment when reading of the immediately previous pack 
is completed as T1 . 

[021 7] The moment T1 is obtained, the system control 
section 21 informs T1 to the video decoders 69c and s 
69d and the audio decoder 1 60. Thus, the video decod- 
ers 69c and 69d and the audio decoder 160 learn that 
the leading packet of system stream #2 will be trans- 
ferred to the video buffer 171 and the audio buffer 172 
thereafter. 

[0218] Accordingly, the two video decoders 69c and 
69d and the audio decoder 1 60 learn the moment when 
the last packet of system stream #1 is transferred and 
obtain T2 and T3 by managing each decoder buffer in 
the same manner as the buffer management of the track 
buffer 23. 

[0219] In the case where T1 is detected, all the data 
has been read from the video decoder buffer 171 or 
audio decoder buffer 172 (immediately after the last 
frame of system stream #1 is decoded), and no data to 
be written has arrived (when the transfer time period 
between packs is empty), there is no data to be written. 
Thus, address management is impossible. Even in this 
case, the packet of the frame to be decoded next before 
then next decoding timing (decoding timing of the lead- 
ing frame of system stream #2) is transferred without 
fail. Accordingly, the switch timing is learned by setting 
the moment of transfer of the packet as T2 or T3. 
[0220] Regarding T4, as described above, "display 
end time of last frame of the video of system stream #1 
(VOB_E_PTM)" can be used as it is. 
[0221 ] Next, a second method for seamless reproduc- 
tion will be described. 

[0222] Figure 31 shows at which timing the system 
stream is reproduced and output after being input to the 
data decoding processing section in Figure 38, passed 
through the decoder buffer and decoded. With refer- 
ence to Figure 31 , a change in each of APTS and VPTS 
values at the connection point of system streams #1 
and #2 will be described, and a method for AV synchro- 
nization control at the seamless connection area during 
the actual stream processing will be described. 
[0223] Then, with reference to the graph in Figure 31 , 
a method for performing seamless connection control in 
accordance with the process represented by the flow- 
chart in Figure 43 will be described. 
[0224] The starting timing of the seamless connection 
control is as shown in part (3) of Figure 31 regarding 
SCR. While the SCR value in the graph is increasing, 
system stream #1 is transferred from the track buffer 23 
(Figure 5) to the data decoding processing section 16 
(Figure 5). Only at point G when the transfer of system 
stream #1 is completed and transfer of system stream 
#2 is started, the SCR value is "0". Accordingly, it is 
found that new system stream #2 is input to the data 
decoding processing section 16 by finding point G at 
which the SCR value is "0". At this point (time Tg), the 
synchronization mechanism control section can turn off 



(release) the AV synchronization mechanism of the 
reproduction output section. 

[0225] It can be detected that the SCR value is "XT 
after the signal read from the optical disk is processed 
or written into the track buffer 23. The AV synchroniza- 
tion mechanism can be turned off based on the detec- 
tion at this point. 

[0226] In order to determine the timing at which AV 
synchronization mechanism once turned off should be 
turned on (started) again, it is necessary to know that 
both the audio output and the video output included in 
system stream #1 have changed to the audio output 
and the video output of new system stream #2 to pre- 
vent inconsistent reproduction by which the audio and 
video signals do not match. The moment the audio out- 
put of the previous system stream is changed to the 
audio output, new system stream #2 can be found by 
detecting point H at which the APTS value stops 
increasing. The moment the video output of the previ- 
ous system stream is changed to the video output, new 
system stream #2 can be found by detecting point I at 
which the VPTS value stops increasing. Accordingly, 
the synchronization mechanism control section can 
restart the AV synchronization at time Ti, i.e., immedi- 
ately after finding that point H and point I both appear. 
[0227] When the SCR value is not set in the SCR or 
the APTS value and VPTS value are directly compared 
with each other during the period from time Tg to time 
Ti, the period in which the AV synchronization mecha- 
nism is off can be further shortened. 
[0228] In order to realize this, both the APTS value of 
the audio output data and the VPTS value of the video 
output data from the data decoding processing section 
16 are monitored, and the value which becomes lower 
first is detected. At this point, i.e., time Th in Figure 31 , 
the AV synchronisation mechanism is turned off. 
[0229] As is apparent, in order to perform the timing 
determination based on whether the APTS and VPTS 
values continue increasing, the APTS and VPTS values 
need to be reduced at the point where the system 
streams are connected. In other words, the last APTS 
and VPTS values in the system stream need to be 
larger than the maximum initial values of APTS and 
VPTS in the system stream. 

[0230] The initial APTS and VPTS values (ATad, ATvd 
in the figure) are determined as follows. 
[0231] The initial APTS and VPTS values are each a 
sum of the time period in which video data or audio data 
is stored in the video buffer or audio buffer and the reor- 
der of the video (in MPEG pictures, the decoding order 
and the display order of the pictures do not necessarily 
match, and display can be delayed by one picture at the 
maximum with respect to the decoding). Accordingly, 
the sum of the time period required for the video buffer 
or audio buffer to become full and the display delay (one 
frame) is the maximum initial value of APTS or VPTS. 
[0232] The system stream can be created so that the 
last APTS and VPTS values in the system stream 
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exceed such values. 

[0233] In this example, the timing for turning on the AV 
synchronization mechanism after the system streams 
are connected has been described to be determined 
based on whether or not the APTS and VPTS values s 
increase. The timing for turning on the AV synchroniza- 
tion mechanism can be determined using the threshold 
value as described below. First, audio and video thresh- 
old values shown in parts (4) and (5) of Figure 31 are 
determined by the reproduction apparatus. These val- 
ues equal to the maximum initial values of APTS and 
VPTS described above. 

[0234] The timing is determined based on whether or 
not the APTS and VPTS values read by the APTS read- 
ing means and VPTS reading means are respectively 
below the audio threshold value and video threshold 
value. When the APTS and VPTS values are larger than 
the audio and video threshold values, data has not been 
changed to the data of the new system stream. When 
the APTS and VPTS values are equal to or smaller than 
the audio and video threshold values, data output of the 
new system stream has been started. Thus, the timing 
for turning on and off the AV synchronization mecha- 
nism may be found. 

[0235] The above-described on/off control of the AV 
synchronization mechanism provides seamless repro- 
duction which is not disturbed at the connection area of 
the system streams. 

(Calculation of the synthesis section) 

[0236] Figure 98 illustrates in detail the calculation of 
the synthesis section of the reproduction apparatus 
shown in Figure 21 and the division calculation of the 
recording apparatus shown in Figure 23. 
[0237] Part (a) of Figure 98 illustrates Figure 23 in 
detail. Regarding the 525P or other progressive signal, 
a q'th line data 283 represented by A and a (q+1)th line 
data 284 represented by B are subjected to the calcula- 
tion of (A+B)+2 by a first division calculation section 141 
of a division calculation section 285, thereby obtaining a 
low frequency component M, which is set as the qlh line 
data of the first stream. In the case of an interlace sig- 
nal, lines 1, 3 and 5 are created in the p'th field. In the 
(P+1)th field, the (q+1)th line data, i.e., lines 2, 4 and 6 
are calculated on a line-by-line basis. The resultant 
interlace signal is encoded by a first encoder 82a. 
[0238] A second division calculation section 143 per- 
forms the calculation of A-B. The DVD format and the 
like do not define a negative value. In order to realize 
compatibility with the conventional formats, (A-B)+2 is 
added to a constant 257 so that a negative value is not 
obtained. In the case of 8-bit data, 1 28 is added as the 
constant 277. As a result of the calculation, an interlace 
signal is created as the q'th line data 280 (S). The inter- 
lace signal is encoded by a second encoder 28b and 
recorded on the disk by the MADM interleave system. 
[0239] With reference to part (b) of Figure 98, a calcu- 



lation of the synthesis section of the reproduction appa- 
ratus shown in Figure 21 will be described in detail. As 
shown in part (a) of Figure 98, the data multiplexed by 
the MADM system according to the present invention 
and recorded on the disk 85 is divided into a first stream 
and a second stream, and processed with decoders 88a 
and 88b to obtain two video signals. This signal is an 
interlace signal and a top line first signal (hereinafter, 
referred to as "TP) in which the top line is an odd line. 
In the synthesis section 90, the calculation of (2M+2S- 
constant)^2 is performed by the first calculation section 
250, where M is the qlh line data of the master signal 
and S is the q'th line data of the sub signal. As a result, 
(A+B+A-B+256-256)-r2=A. The q'th line data (A) is 
obtained and is output as r'th line data 281 (output pic- 
ture). 

[0240] As shown in part (a) of Figure 98, the constant 
277 is added by the second calculation section 143. 
Accordingly, the original data is obtained by subtracting 
the twice the value of the value (128) obtained by syn- 
thesis, i.e., 256. Due to the compatibility, a conventional 
decoder in which negative values are not defined can be 
used. 

[0241 ] Then, the calculation of (2M-2S+(2xconstant)) 
is performed by a second calculation section 251 . As a 
result, (A+B-A-B-256-256)^-2=B. The (q+1)th line data 
284 is obtained and output as (r+1)th line data 282. 
[0242] Thus, two interlace signals are synthesized, 
and a progressive video signal having 480 lines (1st 
through 480th lines) is output. 
[0243] The system shown in Figures 98, 21 and 23 
has a feature that division and synthesis can be con- 
ducted with only one adder and one subtractor for 8-bit 
data and 1 0-bit data and thus the circuit structure is sim- 
plified. Thus, a high resolution picture with progressive 
and wide video signals are obtained with no significant 
cost increase. 

[0244] Since a negative value is reproduced simply by 
adding the constants 278a and 278b to the A-B signal, 
the conventional decoders 279 and 280 which cannot 
handle negative values are usable. 
[0245] As shown in part (a) of Figure 98, in both the 
first stream and the second stream, the first line of the 
first field is an odd line (Top Line First; TF). According an 
encoder of the DVD format, fields are dropped unless 
the streams are Top Line First streams. Since each 
stream is a Top Line First stream according to the sys- 
tem of the present invention, fields are not dropped. 
[0246] Figure 96 shows an overall operation of the 
reproduction apparatus shown in part (b) of Figure 98. A 
reproduction signal is divided by a division section 87 in 
units of nGOP into a first stream and a second stream. 
The first and second streams are decoded by first and 
second decoders 88a and 88b into two Top Line First 
(TF) streams. A Top Line First signal 244 and a Bottom 
Line First signal 245 are created by the first calculation 
section 250 and the second calculation section 251. 
Then, an analog signal such as 525P is output by a DA 



15 



20 



25 



30 



35 



40 



45 



50 



29 



57 



EP 0 944 269 A1 



58 



conversion section 266. 

[0247] In Figure 96, two field pictures having the same 
time stamp are synthesized in a vertical direction. By 
synthesizing the pictures in a horizontal direction 
according to the present invention, the horizontal reso- 
lution can be doubled. Figures 58, 59 and 60 show a 
recording apparatus, and Figure 20 shows a reproduc- 
tion apparatus including a wide picture synthesis sec- 
tion 173. With reference to Figures 91 and 92, the 
principle of the division section of the recording appara- 
tus and the principle of the wide picture synthesis sec- 
tion 1 73 of the reproduction apparatus will be described 
in detail. 

[0248] Figure 91 shows a method for dividing a lumi- 
nance signal and a color signal in the left half. Lumi- 
nance signals Y0 and Y1 of input pixel signals 287a and 
287b having a 1440 pixels in the horizontal direction are 
subjected to addition and subtraction respectively by a 
first division calculation section 141a and a second divi- 
sion calculation section 141b shown in Figures 91 and 
92 of the division calculation section 285 in Figure 98. 
Thus, a luminance signal of (Y0+Y1)/2 of the first 
stream and a luminance signal of (Y0-Y1)/2 of the sec- 
ond stream are generated. The input signal having 1 440 
pixels in the horizontal direction is divided into two video 
signals each having 720 pixels in the horizontal direc- 
tion. The first stream is passed through a horizontal filter 
and thus deprived of a high frequency component. 
Accordingly, even when only the first stream is output on 
the screen by the conventional apparatus, aliasing dis- 
tortion does not occur. Thus, compatibility with the con- 
ventional apparatus is obtained. Figure 92 shows 
processing of a color signal. An input pixel signal 287a 
and an input pixel signal 287c with one input pixel signal 
interposed therebetween are used. From a signal CbO 
of input pixel signal 287a and a signal Cb2 of the input 
pixel signal 287c, a sum signal (Cb0+Cb2)/2 is obtained 
and set as a division pixel signal 290a of the first 
stream. A difference signal (Cb0-Cb2)/2 is set as a divi- 
sion pixel signal 291a of the second stream. In a similar 
manner, (Ct0+Cr2)/2 and (CtO-CrZ)/2 are obtained from 
input pixel signals 287b and 287d. From these signals, 
division pixel signals 290b and 291 b of the first and sec- 
ond streams are obtained. Thus, a high resolution sig- 
nal having 1440 pixel in the horizontal direction is 
divided into two NTSC-grade digital video signals of the 
CCIR601 and SMPTE295M formats. 
[0249] Next, the processing of the synthesis section 
1 73 of the reproduction apparatus briefly described with 
reference to Figure 20 will be described in detail. In the 
synthesis section 90 in Figure 91 , division pixel signals 
288b and 289b of the first and second streams are 
added together by the first calculation section 250 by 
the calculation of (Y6+Y7)/2+(X-Y+256)/2-128=Y6. 
Thus, the input pixel 287g is obtained. Next, the differ- 
ence calculation of (Y6+Y7)/24<X6-Y7+256)/2+128=Y7 
is performed. Thus, the luminance signal of the input 
pixel 287h is obtained, in this manner, a high resolution 



signal having 1440 pixels in the horizontal direction is 
obtained from two signals each having 720 pixels in the 
horizontal direction by a sum calculation and a differ- 
ence calculation. 

5 [0250] Next, synthesis calculation of color signals will 
be described with reference to Figure 92. In the case of 
the Cr signal, the division pixel signals 290d and 291 d 
of the first and second streams are subjected to sum 
calculation by the first calculation section 250 and differ- 

io ence calculation by the second calculation section 251 . 
Specifically, the calculations of (Cr4+Cr6)/2+(Cr4- 
Cr6+256)/2-128=Cr4 and (Cr4+Cr6)/2-(Cr4- 
Cr6+256)/2+128=Cr6 are performed. Cr4 and Cr6 are 
obtained and assigned to input pixel signals 287f and 

15 287h. 

[0251 ] Regarding the Cb signals, similar calculations 
are conducted on the division pixel signals 290c and 
291c. Cr4 and Cr6 are obtained and assigned to input 
pixel signals 287e and 287g. Thus, the luminance sig- 

20 nals and color signals of the input signal are completely 
synthesized to obtain a high resolution signal having 
1440 pixel in the horizontal direction. 
[0252] By the 2X reproduction apparatus, an interlace 
signal having 1440 pixels in the horizontal direction is 

25 obtained. By the reproduction apparatus shown in Fig- 
ure 62, 3-2 transform is performed. In the case where a 
24-frames/sec. signal of a movie or the like is recorded, 
the 24-frames/sec. signal is output a plurality of times by 
the frame memory by the 3-2 transform section 174. 

30 Thus, a 60-frames/sec. progressive video signal is 
obtained. By doubling the horizontal resolution to 1440 
pixels, a wide 525P picture is obtained. Thus, a 
1 440x480P progressive picture is output. 
[0253] Thus, by combining the 3-2 transform section 

35 174 and the wide picture synthesis section 173, a 
1 440x480P high resolution progressive picture is output 
from a 24P picture such as a movie even by the 2X 
reproduction apparatus. When such a picture is repro- 
duced by an existing DVD player, only the sum signal of 

40 the first stream is reproduced, but horizontal interlace 
interference does not occur since the picture is horizon- 
tally filtered. 

[0254] With reference to Figure 97. an operation of 
reproducing data on an MADM disk will be described. 

45 On the MADM disk, a 60-frames/sec. progressive pic- 
ture is divided into two frames, i.e., an odd frame 294 
and an even frame 295. The operation of the division 
section 87 and the decoding section 88 is the same as 
described with reference to Figure 96 and will not be 

so described. In the time direction synthesis section 296, a 
first field 297a and a second field 297b of the first 
stream are synthesized into a first odd frame 294a. A 
first field 298a and a second field 298b of the second 
stream are synthesized into a first even frame 295a. 

55 These frames are synthesized in the time direction in 
the order of the first odd frame 294a, the first even frame 
295a, the first odd frame 294b, and the second even 
frame 295b every 1/60 second. Thus, a 60-frames/sec. 
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progressive picture is reproduced. By the existing 1X 
reproduction apparatus, only the first stream is repro- 
duced; i.e., a 525P interlace signal is reproduced and 
the compatibility is realized. However, the motion is 
slightly unnatural since the picture is a 30-frames/sec. 
picture. This system is an MADM system for recording 
two 30-frames/sec. streams and has the effect of a high 
encoding efficiency of the MPEG encoder due to the 
progressive picture. 

(Optimization of buffer amount) 

[0255] Regarding the total capacity of the track buffer 
circuit 23 in Figure 5, it was described that data for at 
least one interleave block needs to be accommodated 
in the track buffer circuit 23 in order to reproduce two 
streams simultaneously as shown in Figure 45. With ref- 
erence to Figure 87, a buffer amount required for the 
MADM system reproduction according to the present 
invention will be calculated. As the capacity of one inter- 
leave block, the values in Figure 87 are obtained by cal- 
culation. Figure 87 shows interleave unit lengths 
required for 5000-sector and 10000-sector track jumps 
with respect to each of transfer rates. The maximum 
transfer rate is 8 Mbps, and the maximum jump length is 
10000 sectors. With the minimum of 551 sectors as the 
interleave unit length, a stable track jump is realized for 
switching to an interleave unit of another stream even by 
a 1X drive. In actuality, a drive of more than 1X is used, 
and thus the length of 551 sectors is not necessary. In 
consideration of the worst case, the disk manufacturers 
record an interleave unit of 551 or more sectors for an 8 
Mbps stream. Accordingly, a buffer memory for one 
interleave unit is required by the MADM system accord- 
ing to the present invention as shown in Figure 45. Sta- 
ble simultaneous reproduction of two streams is 
realized by setting a buffer memory of 551 sectors or 
more and 1 102 bytes or more. 

(Switching between two pieces of reproduction informa- 
tion) 

[0256] Figures 93, 94 and 95 illustrate a system for 
maintaining the compatibility by reproducing the same 
disk by a conventional apparatus and an apparatus 
according to the present invention. 
[0257] Figure 95 shows an operation of the conven- 
tional apparatus for reproducing an MADM system disk 
according to the present invention in part (a), and shows 
an operation of an MADM system apparatus for repro- 
ducing the MADM system disk in part (b). 
[0258] An optical disk 1 a includes a plurality of (four in 
the figure) streams recorded in a divided manner. 
Accordingly, four interleave units 84a, 84b, 84c and 84d 
having the same information on an n time period are 
recorded on the optical disk 1a in an order. Also on the 
optical disk 1 a, a second reproduction information iden- 
tifier 302 is recorded. The second reproduction informa- 



tion identifier 301 indicates that first reproduction 
information 300 for reproducing streams 1 and 3 and 
second reproduction information 301 for reproducing 
streams 2 and 4 are recorded on the optical disk 1a. 

5 [0259] As shown in part (c) of Figure 95, the first 
reproduction information 300, 300a and 300c has only 
leading address information regarding the interleave 
blocks 84a and 84c corresponding to streams 1 and 3, 
i.e., a pointer. The second reproduction information 

ro identifier 302 is not reproduced by an existing reproduc- 
tion apparatus which does not consider reproduction of 
MADM data. Thus, the second reproduction information 
identifier 301 cannot be read or utilized effectively. 
Accordingly, the conventional apparatus operates as if 

15 only streams 1 and 3 are recorded. Streams 2 and 4 are 
not reproduced at all. A conventional reproduction 
apparatus reproduces, for example, only the left-eye 
information from an optical disk having a 3D signal 
recorded in an MADM system. When 3D display is not 

20 conducted, display of a meaningless right-eye picture is 
prevented. 

[0260] In the case of an optical disk having a high def- 
inition picture recorded in an MADM system, streams 1 
and 3 have basic components, for example, NTSC. 

25 Streams 2 and 4 have a differential signal, i.e., colorless 
line-drawing. Since streams 2 and 4 are not reproduced 
by the conventional apparatus, it is prevented that the 
user views such an unpleasant picture. When such an 
MADM disk is reproduced by a conventional reproduc- 

30 tion apparatus, a normal picture of streams 1 and 3 is 
reproduced but an abnormal picture of streams 2 and 4 
is not reproduced. Accordingly, complete compatibility is 
realized. This operation will be described with a flow- 
chart. As shown in Figure 93, in step 303a, an MADM 

35 disk having m streams is reproduced. First reproduction 
information 300a has pointer information on streams 1 
and 3, i.e. , the leading address of the interleave unit 84e 
to be jumped to next. The address information is used to 
conduct a track jump over a plurality of tracks as shown 

40 in Figure 3 to access the leading address of the inter- 
leave block 84e. The interleave block 84e is the first 
block among the subsequent blocks in stream 1 having 
time information. Thus, data in stream 1 is continuously 
reproduced. 

45 [0261] When an instruction to switch the stream is 
issued in step 303b, whether there is an identifier show- 
ing the existence of a PCI table is present or not is 
checked in step 303c. A DVD has a PCI identifier (non- 
seamless) showing the existence of the second repro- 

50 duction information 301 . An MADM disk has a DSI iden- 
tifier (seamless) showing the existence of the first 
reproduction information is recorded in lieu of the PCI 
identifier. When the disk is an MADM disk, the process- 
ing advances to step 303d to utilize the DSI table having 

55 the first reproductions information. The first reproduc- 
tion information has pointer information on only streams 
1 and 3 in step 303e. Therefore, in step 303f, a track 
jump is conducted based on the pointer information on 
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streams 1 and 3 to maintain the continuous reproduc- 
tion mode of stream 1. Alternatively, stream 1 is 
switched to stream 3, and reproduction is conducted 
continuously in terms of time but while skipping from 
data to data As shown in step 303g, an ordinary NTSC 
picture of streams 1 and 3 is reproduced, but an 
unpleasant, unnecessary picture of streams 2 and 4 is 
not output. Thus, complete compatibility is realized. 
[0262] A process for simultaneously reproducing two 
streams out of streams 1, 2, 3 and 4 by the MADM 
reproduction apparatus will be described with reference 
to Figures 94 and 95. As shown by second reproduction 
information 301, 301a, 301b, 301c and 301 d in part (b) 
of Figure 95, the interleave unit 84a has leading 
address information of the interleave unit 84e, which is 
the next time information of streams 1,2,3 and 4. Since 
a physical addresses of a sector of an arbitrary inter- 
leave unit 84e, 84f, 84g or 84h is found, a track jump is 
easily conducted. The reason is that the MADM repro- 
duction apparatus reproduces the second reproduction 
information identifier 302, learns the existence of the 
second reproduction information, and utilizes the sec- 
ond reproduction information 301 . 
[0263] Thus, simultaneous reproduction of streams 1 
and 2 or streams 3 and 4 is performed, and reproduc- 
tion of a 3D or high resolution signal from an MADM disk 
is realized. The second reproduction information identi- 
fier 302 only needs to distinguish a conventional disk 
from an MADM disk, and can be even 1 -bit data. An 
MADM identifier indicating the existence of a high reso- 
lution signal or 3D signal can be used. 
[0264] This operation will be described with reference 
to the flowchart in Figure 94. In step 304a, an MADM 
disk is reproduced. In step 304b, it is checked whether 
there is a second reproduction information identifier 302 
or not, or whether there is an MADM high resolution/3D 
identifier or not. If no, the disk is determined to be a con- 
ventional disk and the processing goes to step 304h. If 
yes, the processing goes to step 304c to check for the 
identifier of the interleave unit 84. If there is an identifier 
showing the existence of the second reproduction infor- 
mation, or if there is a seamless identifier in the case of 
the DVD, the seamless identifier is interpreted as a non- 
seamless identifier. The second reproduction informa- 
tion, which is not actually valid, is regarded as being 
valid in step 304d. In step 304e, link information on 
steps 1,2,3 and 4 is extracted from the second repro- 
duction information. 

[0265] In step 304f, first reproduction information, or a 
main stream which is switchable from the DSI table in 
the case of the DVD, is detected. In the example shown 
in Figure 95, streams 1 and 3 are found to be main 
streams. The first reproduction information includes 
main stream information, and the second reproduction 
information includes main and sub stream information. 
Accordingly, the main and sub streams can be distin- 
guished based on the first and second reproduction 
information. In the case of Figure 95. the number of 



stream groups (angles) is found to be 2 by checking the 
second reproduction information. 
[0266] When an instruction to switch the stream 
(angles) is issued in step 304g, a switch from stream 1 

5 to stream 3 is conducted in step 304m. For this, simul- 
taneous reproduction mode (A) for streams 1 and 2 
using pointer information on streams 1 and 2 of the sec- 
ond reproduction information is switched to simultane- 
ous reproduction mode (B) for streams 3 and 4. In other 

io words, stepping access to the interleave units 84a. 84b, 
84e and 84f is switched to stepping access to the inter- 
leave units 84c. 84d and 84g. Thus, two-stream groups 
can be switched in units of two streams. 
[0267] Returning to step 304h. when a seamless iden- 

is trfier indicating the second reproduction information is 
invalid is recorded on the disk, the conventional appara- 
tus regards the second reproduction information (PCI) 
as being invalid in step 304]. Thus, only streams 1 and 
3 are reproduced using only the first reproduction infor- 

20 mation (DSI) in step 304k. 

[0268] As described above, by detecting either the 
conventional or the MADM identifier, the second repro- 
duction information which is not valid in accordance with 
the conventional rule is regarded as being valid. Accord- 

25 ingly, a meaningless or unpleasant picture is not output 
from the MADM disk even by a conventional apparatus. 
Thus, the compatibility is improved. 

(2-screen simultaneous reproduction) 

30 

[0269] With reference to Figure 90, an operation of the 
2-screen synthesis section 28 described with reference 
to Figure 5 will be described in detail. Although n pieces 
of screens are used, the representation of 2-screen is 

35 used in this specification. To the n-screen synthesis 
section 28b in Figure 90, a first picture (A) and a second 
picture (B) of the first stream, a first sub picture and a 
second sub picture are input. In a simple structure, a 
line memory 28c is included. In this case, line-synthesis 

40 of the first picture (A) 28p and the second picture (B) 
28q results in a picture of mode 1 L having two screens 
side by side is obtained. Audio signals (A) and (B) of the 
first and second streams are synthesized by an audio 
mixer 28f. In the case of mode 1 U only the audio signal 

45 (A) is output. In mode 2L, a first sub picture of the first 
stream is synthesized on the screen. Only one sub pic- 
ture 28r such as subtitles is selected and displayed by 
the n-screen synthesis section 28b. This has an effect 
of enlarging the display. In mode 2L, a second audio sig- 

50 nal B is output after mixing to the speaker to the right of 
the screen. Thus, the second audio signal 28s of the 
second picture B can be listened to at a low volume. 
[0270] As a higher structure, a frame memory 28d can 
be used. In this case, zooming of two screens is real- 

55 ized. A zoom signal generation section 28e which has 
received a zoom instruction signal 28p sends a ratio 
change signal to the n-screen synthesis section 28b 
and the audio mixer 28f. When the first picture (A) is 
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enlarged as shown in the 2-screen picture 28i in mode 
1 , the first audio signal is used. In an opposite case, the 
second audio signal is output as in the 2-screen picture 
28j. Thus, by changing the ratio of the video signals and 
audio signals of the first and second streams, video and 
audio can be matched. Pictures of streams 3 through 6 
can be displayed in a divided manner as shown in a 2- 
screen picture 28m. 

[0271 ] As described above, in the embodiment where 
two streams are simultaneously reproduced to output 
two video signals, and the synthesis of video signals 
and synthesis of audio signals are performed using the 
2-screen synthesis sections 28 and 28b and the audio 
mixer 28f, two streams, for example, pictures taken by 
two cameras can be viewed simultaneously. 

(Alteration of the filter) 

[0272] According to the present invention, a video sig- 
nal is divided into a low frequency component and a 
high frequency component by a picture division section 
141a shown in, for example, Figure 22. The division fil- 
ter can be represented as in Figure 46. In Figure 22, 
division calculation of the first stream is conducted by 
calculation parameters of ml=0, m2=1/2, m3=1/2, and 
m4=0. Division calculation of the second stream is con- 
ducted by calculation parameters of m1=0, m2=1/2, 
m3=-1/2, and m4=0. Under these conditions, a 525P 
progressive signal is divided into a low frequency com- 
ponent and a high frequency component at the vertical 
resolution of 250. 

[0273] The dividing frequency of the border can be 
altered by changing the calculation parameters of ml, 
m2, m3 and m4. As shown in Figure 50, the dividing fre- 
quency can be changed from 200, to 250 and to 300, 
and each filter identifier 144 can be recorded on the 
optical disk. Thus, the filter identifier 144 is detected by 
a filter identifier reproduction section 305 of the repro- 
duction apparatus in Figure 96 during data reproduc- 
tion, and the set values of calculation parameters of n1 
n2, n3 and n4 of the calculation section 212a are 
changed by a calculation parameter output section 306 
in accordance with the filter identifier in Figure 50. The 
calculation section 212a of the synthesis section 90 per- 
forms calculation by the set values and processes verti- 
cal lines n-1, n, n+1 and n+2 based on the calculation 
parameters 196 of n1, n2, n3 and n4, thereby obtaining 
the n-line signal. This processing can be actually per- 
formed in the first calculation section 250 and the sec- 
ond calculation section 251 . 

[0274] By changing the dividing frequency of the pic- 
ture division filter, the distribution of the data amount 
between the first and second streams can be changed. 
In the case of the DVD format, the first and second 
streams each have a maximum capacity of 8 Mpbs. 
When the dividing frequency is fixed, a picture having a 
high ratio of high frequency component causes the sec- 
ond stream data to overflow, resulting in collapse of 



MPEG encoding signal in the high frequency range. A 
picture having a high ratio of low frequency component 
causes the first stream data to overflow, resulting in col- 
lapse of encoding to significantly deteriorating the pic- 

5 ture quality. In the case where the dividing frequency is 
variable, when the high frequency component is exces- 
sive, the dividing frequency in Figure 50 can be 
increased to 300. Thus, the second stream data amount 
is reduced and the first stream data amount is 

10 increased. Thus, the distribution of the data is opti- 
mized, so that the collapse of encoding is avoided. 
[0275] When the low frequency component is exces- 
sive, the dividing frequency can be decreased to 200. 
Thus, the first stream data amount is reduced, which 

15 avoids collapse. Collapse is usually avoided this way, 
and the variable dividing frequency is effective. By 
changing the border of the division filter in accordance 
with the condition of the picture, collapse of encoding of 
one of the streams can be avoided. Accordingly, a satis- 

20 factory video signal is obtained. In other words, the 
overflow of the first or second stream is avoided by 
changing the division point, so that recording and repro- 
duction are performed with the data amount being dis- 
tributed in a satisfactory manner. 

25 

(Scanning line transform) 

[0276] An operation of a scanning line transform sec- 
tion 29a described with reference to Figure 5 will be 

30 specifically described. An MADM disk includes both an 
area having a high resolution signal such as a progres- 
sive signal and an area having a standard resolution 
signal such as an NTSC signal. The two streams are 
reproduced simultaneously and independently. The out- 

35 put is changed from progressive to NTSC or from NTSC 
to progressive. When a signal is output from the output 
section 29b with no processing at the point of change, 
the scanning frequency is changed from 31.5 kHz to 
15.7 kHz. Therefore, the deflection frequency of the TV 

40 29c is switched, thus disturbing the picture for a few 
seconds. Even in a TV having a built-in line doubler, the 
picture is disturbed when a progressive picture is 
switched to an NTSC picture. According to the present 
invention, this is avoided by automatically switching the 

45 progressive signal by the output section 29b. In more 
detail, the NTSC picture of the first stream is scanned at 
2X by the scanning transform section 29a using an 
MADM disk identifier 10h recorded on the MADM disk 1 
or the progressive signal is output as it is. Since the high 

so resolution area for reproducing two streams is switched 
to an ordinary resolution area for reproducing one 
stream, the output signal is immediately changed. 
Therefore, a progressive signal is continuously input to 
the TV 29c. This system eliminates disturbance from 

55 the TV picture. 
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(Stream switching prohibiting flag) 

[0277] As a method for preventing a differential signal 
of a high resolution signal from being output in an exist- 
ing apparatus, a method for recording a stream switch- 
ing prohibiting flag will be described. 
[0278] As shown in Figure 86, in step 307a, a stream 
switching prohibiting flag 309 is recorded on a disk 1c. 
In step 307b, stream 1 is set as the initial stream value 
in the management information. 
[0279] When the disk 1 c is set in an existing reproduc- 
tion apparatus, in step 307a, management information 
for angle 1, i.e., stream 1 is read. In step 307f, angle 1 
is reproduced. When an angle switch instruction is 
issued in step 307g, an angle (stream) switching prohib- 
iting flag is checked in step 307h. In an MADM disk, the 
angle (stream) is not switched since the flag is 
recorded. Accordingly, the output of the differential pic- 
ture is prevented and the compatibility is maintained. 

(HDTV(1080i) output) 

[0280] A method for creating a 1 080i picture to be out- 
put to an HDTV will be described. In Figure 20, a wide 
525P picture is displayed as shown in the scope screen 
178. The output is transformed into a progressive signal 
having 1050 lines by a line doubler. The progressive sig- 
nal is further transformed into an interlace signal having 
1050 lines by an interlace transform section 175b. That 
is, an interlace picture 178b having about 1080 lines is 
obtained. Thus, output to the HDTV is realized. 

(High definition audio output) 

[0281] In Figure 20, a high definition audio signal is 
reproduced. In the case of linear PCM, a range of 1.5 
Mbps to 4 Mbps is required. In MADM, as shown in Fig- 
ure 88, a basic audio section 312 is recorded in stream 
1 with 380 kbps AC3, and a high definition audio section 
313 is in stream 3. An audio recording identifier 314 is 
recorded as an MADM identifier. In the reproduction 
apparatus in Figure 20, when an audio recording identi- 
fier 314 is reproduced by an audio recording identifier 
reproduction section 111, an audio signal is separated 
from the stream 2, and a high definition audio signal is 
reproduced by an audio decoder 1 60a and output as an 
audio signal in the figure. 

[0282] In the case of DVD, one stream has only a max- 
imum of 8 Mbps. When a high definition audio signal 
which can have a maximum 4 Mbps is recorded into 
stream 1 which already has a basic picture, the basic 
picture is restricted to only 4 Mbps and deteriorated in 
terms of quality. Thus, compatibility is not maintained. 
According to the present invention, the audio signal is 
accommodated in streams 2, 3 and 4 as the high defini- 
tion audio signals 313a. 313b and 313c in Figure 88. In 
this manner, the high definition audio signals can be 
recorded without deteriorating the quality of the basic 



picture. Especially, the data amount of 525P differential 
signal in stream 2 is 1/2 to 1/3 of the basic picture, and 
thus stream 2 still has about 4 Mbps. Even when the dif- 
ferential video signal and the high definition signal are 
5 recorded in streams 2 and 4 as the high definition audio 
signals 313a and 313b in Figure 88, the high definition 
video and audio signals can be reproduced by a 2X 
reproduction apparatus without deteriorating the differ- 
ential signal. 

70 

(Comparison method of MADM identifier) 

[0283] As shown in Figure 4, an MADM disk has an 
MADM identifier in management information such as a 

15 TXT file. However, the TXT file may possibly have the 
same data as the MADM identifier in error. When the 
non-MADM disk is reproduced as an MADM disk, mal- 
function occurs and an abnormal picture is synthesized 
and output. In order to avoid such malfunction, authen- 

20 tification data for comparison is recorded according to 
the present invention. 

[0284] As shown in Figure 1, an authentification data 
generation section 315 is provided. The MADM identi- 
fier 10b and inherent attribute information 316 of the 

25 disk (master disk) such as the title of the disk, disk ID, 
disk capacity, and final address value are calculated by 
authentification data generation calculation section 31 6. 
Thus. MADM authentification data 318 is generated. 
The MADM authentification data 318 is recorded on the 

30 optical disk 1 together with the MADM identifier 1 0b and 
the authentification data 318 or progressive/3 D 
arrangement information. 

[0285] Then, the optical disk 1 is reproduced by the 
reproduction apparatus in Figure 5 and compared by an 

35 MADM identifier comparison section 26a. 

[0286] The operation will be described in detail with 
reference to Figure 9. The MADM identifier comparison 
section 26a reads the MADM identifier 10b, the MADM 
authentification data 318, and the inherent attribute 

40 information 316 such as the title of the disk, disk 
number, capacity, and address from the optical disk 1 , 
and compares the three types of data by the compari- 
son calculation section 319. Only when it is determined 
that the data is correct by the determination section 320, 

45 an instruction to reproduce the MADM disk by the 
MADM reproduction section 321 is sent to the control 
section 21 . Thus, the two streams are synthesized to 
output a high resolution picture or a 3D picture. When it 
is determined that the data is incorrect by the determi- 

so nation section 320. an instruction to perform ordinary 
reproduction by an ordinary reproduction section 322 
without MADM reproduction is sent. 
[0287] In this manner, even when the same data as 
the MADM identifier 10b is recorded in the TXT file in 

55 error, the MADM reproduction apparatus performs com- 
parison using the comparison data. Accordingly, mal- 
function is prevented. The authentification data and the 
MADM identifier can be one piece of data, or encrypted 
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data of the MADM identifier and the disk attribution 
information can be recorded. 

[0288] So far, applications of a system for reproducing 
and synthesizing a plurality of streams, i.e., an MADM 
system according to the present invention have been 5 
described. Hereinafter, MADM synchronization systems 
will be described. 

(Example 2) 

10 

[0289] The MADM system according to the present 
invention simultaneously reproduction of a plurality of 
streams. Synchronization methods are important. In the 
second through eighth examples, various methods of 
synchronization will be described. The MADM system is is 
also applicable to recording and reproduction of high 
resolution pictures such as 3D or 525P pictures, which 
will not be described below. 

[0290] As an example, in the second example, an 
operation of a reproduction apparatus for reading data 20 
from an optical disk having three compression video 
signals to be reproduced simultaneously and extending 
and reproducing the three compression video signals 
simultaneously will be described. 

[0291 ] Figure 66 shows a data structure of the optical 25 
disk used in the optical disk reproduction apparatus in 
the second example. 

[0292] Video signals A, B and C are MPEG-com- 
pressed to obtain compression video streams A, B and 
C. 30 
[0293] The compression video streams A, B and C are 
each packeted in units of 2 kB into packets. A packet 
header of each packet includes a stream ID for indicat- 
ing which one of the compression video streams A 
through C is stored. When the packet stores a leading 35 
part of the video frame, the packet header also includes 
VPTS (video presentation time stamp) as video repro- 
duction time information indicating the time to repro- 
duce the frame. In the second example, an NTSC signal 
is used as the picture signal, and the video frame cycle 40 
is about 33 msec. 

[0294] On the optical disk, video packets created in 
the above-described manner are grouped into, for 
example, compression video signals A-1, B-1 and C-1 
each including an appropriate number of packets based 45 
on the data stored, and multiplexed. 
[0295] Figure 64 is a block diagram of the optical disk 
reproduction apparatus in the second example. 
[0296] In Rgure 64, the optical disk reproduction 
apparatus includes an optical disk 501 described above, so 
an optical pickup 502 for reading data from the optical 
disk 501, signal processing means for performing a 
series of signal processing such as binarization, 
demodulation, and error correction to the signal read by 
the optical pickup 502, a buffer memory 504 for tempo- ss 
rarily storing the data output from the signal processing 
means 503, division means 505 for dividing the data 
read from the buffer memory 504 into compression 



video signals, and reference time signal generation 
means 506 for generating a reference time signal 506 
including a counter (not shown) for counting 90 kHz 
clocks. Reference numerals 510, 520 and 530 repre- 
sent buffer memories for temporarily storing the com- 
pression video signals divided by the division means 
505. Reference numerals 511, 521 and 531 represent 
video decoders for extending and reproducing the com- 
pression video signals. Reference numerals 512, 522 
and 532 represent monitors for displaying the video sig- 
nals. 

[0297] Figure 65 shows the structure of each of the 
video decoders 51 1 , 521 and 531 . 
[0298] As shown in Figure 65, the video decoder 
includes VPTS detection means 601 for detecting a 
VPTS stored in the packet header of the video packet, 
video extension means 602 for MPEG-extending the 
compression video stream, and video reproduction tim- 
ing control section 603 for comparing the reference time 
signal and the VPTS and skipping or repeating the 
video reproduction on a frame-by-frame basis when the 
comparison result exceeds the threshold value. 
[0299] The optical disk reproduction apparatus shown 
in Figure 64 operates in the following manner. 
[0300] The optical pickup is focus-controlled or track- 
ing-controlled by servo means (not shown) to read a 
signal from the optical disk 501 and outputs the signal to 
the signal processing means 503. The signal process- 
ing means 503 subjects the signal to a series of 
processings including binarization, demodulation, error 
correction and the like. Then, the signal processing 
means 503 stores the resultant signal in the buffer 
memory 504 as digital data. 

[0301 ] The buffer memory 504 functions so that, even 
when the data supply from the optical disk 501 is tempo- 
rarily stopped by, e.g., wait state, data supply to the sub- 
sequent-stage sections is not stopped. 
[0302] The data read from the buffer memory 504 is 
divided into compression video signals A through C by 
the division means 505 and output. The division means 
identifies which of the compression video signals A 
through C is stored in each packet with the packet ID in 
the packet header of the packeted data, and determines 
the destination based on the identification result. 
[0303] The divided compression video signals are 
respectively stored in buffer memories 51 0 through 530. 
[0304] The buffer memories 510 through 530 act to 
continuously supply data to the video decoders 511 
through 531. 

[0305] The video decoders 51 1 through 531 read data 
from the buffer memories 510 through 530 respectively, 
extend the compression signals, and output the signals 
as video signals to the monitors 512 through 532 
respectively. 

[0306] With reference to Figure 65, an operation of the 
video decoders 51 1 through 531 will be described. 
[0307] The compression video signal read from the 
buffer memory is input to the VPTS detection means 
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601 and the video extension means 602. 
[0308] The video extension means 602 MPEG- 
extends the compression video stream and outputs the 
video signal. 

[0309] The VPTS detection means 601 detects the 5 
VPTS of the packet header. 

[0310] The video reproduction timing control means 
603 receives the video signal output from the video 
extension means 602, a reference time signal and the 
VPTS output from the VPTS detection means 601 , and 
compares the reference time signal and the VPTS. 
When the difference between the two exceeds the 
threshold value, the video reproduction timing is control- 
led so that the difference between the VPTS and the ref- 
erence time signal is equal to or less than the threshold 
value. 

[031 1 ] In the second example, 33 msec is used as the 
threshold value. The video reproduction timing control 
means 603 performs the following. 

(reference time signal- VPTS) >33 msec.:1 frame is 
skipped. 

(reference time signal-VPTS)<-33 msec.:1 frame is 
repeated. 

[0312] In the second example, due to the precision 
error of the crystal oscillator used in the reference time 
signal generation means 506 and the video decoders 
511 through 531, the video decoders 511 and 531 are 
slower and the video decoder 521 is faster in terms of 
extension and reproduction with respect to the refer- 
ence time signal. Unless reproduction timing is cor- 
rected, the reproduced video signals are out of 
synchronization. 

[0313] Figure 67 is a timing diagram of video repro- 
duction in the second example. Part (a) of Figure 67 
shows the reference time signal with respect to repro- 
duction time t. Part (b) shows the VPTS#A, which is a 
VPTS of the compression video signal A to be extended 
by the video decoder 51 1 , part (c) shows the VPTS#B, 
which is a VPTS of the compression video signal 6 to be 
extended by the video decoder 521 , and part (d) shows 
the VPTS#C, which is a VPTS of the compression video 
signal C to be extended by the video decoder 531 . 
[0314] The video decoder 511 continues extension 
and reproduction of the compression video signal A, 
and the difference between the VPTS#A and the refer- 
ence time signal exceeds 33 msec, as the threshold 
value at T1 . Accordingly, the video reproduction timing 
control means of the video decoder 511 skips one 
frame, which is originally to be reproduced, to correct 
the reproduction timing so that the difference between 
the VPTS#A and the reference time signal is equal to or 
less than the threshold value. 
[0315] The video decoder 521 continues extension 
and reproduction of the compression video signal B, 
and the difference between the VPTS#B and the refer- 
ence time signal exceeds -33 msec, as the threshold 



value at T2. Accordingly, the video reproduction timing 
control means of the video decoder 521 reproduces one 
frame in repetition, which has been already reproduced, 
to correct the reproduction timing so that the difference 
between the VPTS#B and the reference time signal is 
equal to or less than the threshold value. 
[0316] Similarly, the video decoder 531 continues 
extension and reproduction of the compression video 
signal C, and the difference between the VPTS#C and 
the reference time signal exceeds 33 msec, as the 
threshold value at T3. Accordingly, the video reproduc- 
tion timing control means of the video decoder 531 
skips one frame, which is originally to be reproduced, to 
correct the reproduction timing so that the difference 
between the VPTS#C and the reference time signal is 
equal to or less than the threshold value. 
[0317] As described above, in the second example, 
when the difference between the reference time signal 
and the VPTS detected by each video decoder exceeds 
the threshold value, the video reproduction timing con- 
trol means of each video decoder performs correction 
so that difference between the reference time signal and 
the VPTS does not exceed the threshold value. In this 
manner, the pictures reproduced by video decoders can 
be synchronized with one another. 

(Example 3) 

[0318] The third example relates to a reproduction 
apparatus for correcting a reference time signal using 
audio reproduction time information indicating the time 
to reproduce the audio signal and synchronizes a plural- 
ity of video signals based on the reference time signal. 
[031 9] Figure 70 shows a data structure of the optical 
disk used in the optical disk reproduction apparatus in 
the third example. The optical disk includes compres- 
sion audio data in addition to the data included in the 
optical disk used in the second example. 
[0320] An audio signal is audio-framed in units of 32 
msec, for compression to obtain a compression audio 
stream. The audio stream is packeted in units of 2 kB 
into audio packets and recorded on the optical disk. A 
packet header of each audio packet includes a stream 
ID for indicating that the stored data is a compression 
audio stream. When the packet stores a leading part of 
the audio frame, the packet header also includes APTS 
(audio presentation time stamp) as audio reproduction 
time information indicating the time to reproduce the 
frame. 

[0321] Figure 68 is a block diagram of the reproduc- 
tion apparatus in the third example. 
[0322] Elements 501 through 532 are the same as 
those shown in Figure 64 in the second example. 
[0323] Reference numeral 504 represents a buffer 
memory for temporarily storing the compression audio 
signal. Reference numeral 541 represents audio exten- 
sion means for extending the compression audio signal. 
Reference numeral 542 represents a speaker for repro- 
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ducing the extended audio signal. 

[0324] Figure 69 shows a structure of the audio 

decoder 541. The audio decoder 541 includes APTS 

detection means 701 for detecting an APTS stored in a 

packet header of the audio packet, and audio extension 

means 702 for extending the compression audio 

stream. 

[0325] An operation of the optical disk reproduction 
apparatus shown in Figure 68 for reproducing the opti- 
cal disk shown in Figure 70 will be described. 
[0326] The operation until the signal is input to the 
division means 505 is similar to that with the optical disk 
reproduction apparatus in the second example. 
[0327] The data read from the buffer memory 504 is 
divided into compression video signals A through C and 
a compression audio signal by the division means 505 
and output. The division means 505 identifies which of 
the compression video signals A through C and the 
compression audio signal is stored in each packet with 
the packet ID in the packet header of the packeted data, 
and determines the destination based on the identifica- 
tion result. 

[0328] The divided compression video signals and 
compression audio signal are respectively stored in 
buffer memories 510 through 540. 
[0329] The video decoders 51 1 through 531 read data 
from the buffer memories 510 through 530 respectively, 
extend the compression video signals, and output the 
signals as video signals to the monitors 512 through 
532 respectively. The audio decoder 541 reads data 
from the buffer memory 540, extends the compression 
audio signal, and outputs the signal as an audio signal 
through the speaker 542. 

[0330] The operations of the video decoders 511 
through 531 for extending the compression video sig- 
nals and for correcting the synchronization when the dif- 
ference between the reference time signal and the 
VPTS exceeds the threshold value are the same as in 
the second example. 

[0331 ] The compression audio signal read from the 
buffer memory 540 is input to the audio decoder 541 . 
APTS detection means 701 detects an APTS and out- 
puts. Audio extension means 702 extends the compres- 
sion audio stream and outputs the audio signal. 
[0332] The VPTS signal output from the audio 
decoder 541 is input to the reference time signal gener- 
ation means 506, and the reference time signal is cor- 
rected by the APTS. 

[0333] In the third example, due to the precision error 
of the crystal oscillator used in the reference time signal 
generation means 506, the video decoders 51 1 through 
531 and the audio decoder 541 , the reference time sig- 
nal is faster in terms of extension and reproduction with 
respect to the audio decoder 541 . The video decoder 
511 is slower and the video decoder 521 is faster in 
terms of extension and reproduction with respect to the 
reference time signal. Unless reproduction timing is cor- 
rected, the reproduced video signals and audio signal 



are out of synchronization. 

[0334] Figure 71 is a timing diagram of audio repro- 
duction in the third example. Part (a) of Figure 71 shows 
the APTS with respect to reproduction time t. Part (b) 

5 shows the reference time signal. Part (c) shows the 
VPTS#A, at which the compression video signal A to be 
extended by the video decoder 51 1 is to be reproduced, 
and part (d) shows the VPTS#B, at which the compres- 
sion video signal B to be extended by the video decoder 

w 521 is be reproduced. 

[0335] Figure 71 does not show the VPTS#C, at which 
the compression video signal C to be extended by the 
video decoder 531 , but the diagram is almost the same 
as in Figure 67 regarding the second example. 

15 [0336] The reference time signal generation means 
506 is corrected using the APTS at time when the APTS 
shows tal and ta2, and the reference time signal is 
reset as tal and ta2 at the respective time. 
[0337] The video decoder 511 continues extension 

20 and reproduction of the compression video signal A, 
and the difference between the VPTS#A and the refer- 
ence time signal exceeds 33 msec, as the threshold 
value at T4. Accordingly, the video reproduction timing 
control means of the video decoder 51 1 skips one frame 

25 which is originally to be reproduced to correct the repro- 
duction timing so that the difference between the 
VPTS#A and the reference time signal is equal to or 
less than the threshold value. 

[0338] The video decoder 521 continues extension 

30 and reproduction of the compression video signal B, 
and the difference between the VPTS#B and the refer- 
ence time signal exceeds -33 msec, as the threshold 
value at T5 and T6. Accordingly, the video reproduction 
timing control means of the video decoder 521 repro- 

35 duces one frame in repetition which has been already 
reproduced to correct the reproduction timing so that 
the difference between the VPTS#B and the reference 
time signal is equal to or less than the threshold value. 
[0339] As described above, in the third example, when 

40 the difference between the reference time signal and 
the VPTS detected by each video decoder exceeds the 
threshold value, the video reproduction timing control 
means of each video decoder performs correction so 
that difference between the reference time signal and 

45 the VPTS does not exceed the threshold value. In this 
manner, the pictures reproduced by video decoders can 
be synchronized with one another. 
[0340] Regarding the difference between the refer- 
ence time signal and the APTS, the APTS is not cor- 

so rected using the reference time signal but the reference 
time signal is corrected using the APTS. Accordingly, 
audio and video signals are synchronized with no 
unnatural ness in the audio output. 



[0341] The fourth example relates to a reproduction 
apparatus for correcting the reference time signal using 
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a VPTS detected by one video decoder and synchroniz- 
ing a plurality of video signals based on the reference 
time signal. 

[0342] Figure 72 is a block diagram of an optical disk 
reproduction apparatus in the fourth example. 
[0343] Elements 501 through 532 are the same as 
those in the second example. Reference numeral 551 
represents a video decoder used in the fourth example. 
[0344] The video decoder 551 has a function of out- 
putting the detected VPTS. Figure 73 shows a structure 
of the video decoder 551 . 

[0345] The video decoder 551 includes VPTS detec- 
tion means 801 for detecting a VPTS indicating the 
reproduction time of the video signal multiplexed as the 
compression video signal and video extension means 
802 for extending the compression video stream. 
[0346] In the fourth example, due to the precision error 
of the crystal oscillator used in the reference time signal 
generation means 506 and the video decoders 521 , 531 
and 551 , the reference time signal is faster in terms of 
extension and reproduction with respect to the video 
decoder 551 . The video decoder 521 is slower and the 
video decoder 531 is faster in terms of extension and 
reproduction with respect to the reference time signal. 
Unless reproduction timing is corrected, the reproduced 
video signals are out of synchronization. 
[0347] Figure 74 is a timing diagram of video output in 
the fourth example. Part (a) of Figure 74 shows the 
VPTS#A detected by the video decoder 511 with 
respect to reproduction time t. Part (b) shows the refer- 
ence time signal. Part (c) shows VPTS#B, at which the 
compression video signal B to be extended by the video 
decoder 521 is to be reproduced, and part (d) shows the 
VPTS#C, at which the compression video signal C to be 
extended by the video decoder 531 is to be reproduced. 
[0348] The reference time signal generation means 
506 is corrected using the APTS at time when the APTS 
shows tv1 and tv2, and the reference time signal is reset 
as tv1 and tv2 at the respective time. 
[0349] The video decoder 521 continues extension 
and reproduction of the compression video signal B, 
and the difference between the VPTS#B and the refer- 
ence time signal exceeds 33 msec, as the threshold 
value at T7. Accordingly, the video reproduction timing 
control means of the video decoder 521 skips one frame 
which is originally to be reproduced to correct the repro- 
duction timing so that the difference between the 
VPTS#B and the reference time signal is equal to or 
less than the threshold value. 

[0350] Similarly, the video decoder 531 continues 
extension and reproduction of the compression video 
signal C. and the difference between the VPTS#C and 
the reference time signal exceeds 33 msec, as the 
threshold value at T8. Accordingly, the video reproduc- 
tion timing control means of the video decoder 531 
reproduces one frame in repetition which has been 
already reproduced to correct the reproduction timing 
so that the difference between the VPTS#C and the ref- 



erence time signal is equal to or less than the threshold 
value. 

[0351] As described above, in the fourth example, 
when the difference between the reference time signal 

5 and the values of VPTSs detected by the video decod- 
ers 521 and 531 exceeds the threshold value, the video 
reproduction timing control means of each video 
decoder performs correction so that the difference 
between the reference time signal and the VPTS does 

10 not exceed the threshold value. 

[0352] By correcting the reference time signal using 
the VPTS#A detected by the video decoder 551, the 
video signal reproduced by the video decoder 551 is not 
accompanied by any unnaturalness in the visual output 

15 due to the frame-by-frame skipping or repeated repro- 
duction. Thus, the pictures can be synchronized with 
one another. 

(Example 5) 

20 

[0353] The fifth example relates to a reproduction 
apparatus including a plurality of video decoders for 
extending and reproducing a compression video signal. 
Each of the video decoders includes reference time sig- 

25 nal generation means. The reproduction apparatus cor- 
rects the reference time signal of each video decoder 
using an APTS indicating the time to reproduce an 
audio signal to realize synchronization. 
[0354] In the fifth example, the optical disk shown in 

30 Figure 70 is used. 

[0355] Figure 75 is a block diagram of an optical disk 
reproduction apparatus in the fifth example. 
[0356] Elements 501 through 542 are the same as 
those shown in Figure 68 in the third example. Unlike 

35 the reproduction apparatus shown in Figure 68, the 
reproduction apparatus in this example does not have 
reference time signal generation means 506 independ- 
ently, but each video decoder has reference time signal 
generation means. 

40 [0357] Reference numeral 561 represents a video 
decoder for extending and reproducing compression 
video signal A, reference numeral 571 represents a 
video decoder for extending and reproducing compres- 
sion video signal B, and reference numeral 581 repre- 

45 sents a video decoder for extending and reproducing 
compression video signal C. 

[0358] Figure 76 shows a structure of each of the 
video decoders 561 through 581 used in the fifth exam- 
ple. 

so [0359] The video decoder includes VPTS detection 
means 901 for detecting a VPTS indicating the repro- 
duction time of the video signal multiplexed as the com- 
pression video signal, video extension means 902 for 
extending the compression video stream, and video 

55 reproduction timing control means 903 for comparing 
the reference time signal and the VPTS and skipping or 
repeating the video reproduction on a frame-by-frame 
basis when the comparison result exceeds the thresh- 
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old value, and reference time signal generation means 
904 for generating the reference time signal. 
[0360] In the fifth example, the reference time signal 
of reference time signal generation means 904 included 
in each of the video decoders 561 through 581 is cor- 
rected using the APTS detected by the video decoder 
541. 

[0361 ] Since the reference time signals are corrected 
using the same APTS. the reference time signals gener- 
ated in the video decoders 561 through 581 show the 
same value after being corrected. 
[0362] After the correction using the APTS, as in the 
third example, when the difference between the refer- 
ence time signal and the values of VPTS detected by 
each video decoder exceeds the threshold value, the 
video reproduction timing control means of each video 
decoder performs correction by skipping or repeating 
the reproduction on a frame-by-frame basis so that dif- 
ference between the reference time signal and the 
VPTS does not exceed the threshold value. 
[0363] As described above, in the fifth example, the 
reference time signal generated in each video decoder 
is corrected with an APTS, and the video reproduction 
timing control means of each video decoder maintains 
the difference between each reference time signal and 
each VPTS to be equal to or less than the threshold 
value. Thus, the pictures can be synchronized with one 
another. 

[0364] As in the third example, the audio signal and 
the video signal can be synchronized without providing 
any inconvenience in the audio output. 
[0365] In the fifth example, the reference time signals 
in the video decoders 561 through 581 are corrected 
using the APTS detected by the audio decoder 541 . The 
pictures can be reproduced in synchronization in a sim- 
ilar manner by using one of the video decoders shown 
in Figure 73 in the fourth example and correcting the ref- 
erence time signals of the other video decoders using 
the VPTS detected by the one video decoder. 

(Example 6) 

[0366] The sixth example relates to a reproduction 
apparatus for simultaneously reproducing two compres- 
sion video signals. The two compression video signals 
are obtained by dividing a signal into a right-eye video 
signal and a left-eye video signal and compressing the 
divided video signals. 

[0367] The overall structure of the apparatus is gener- 
ally similar to that of the optical disk reproduction appa- 
ratus shown in Figure 75 in the fifth example, but the 
reproduction apparatus in the sixth example includes 
two video decoders for extending compression video 
signals obtained after the division means 505 since two 
video signals are to be reproduced simultaneously. Fig- 
ure 77 shows a structure of one of the video decoders 
used in the sixth example, and Figure 78 shows a struc- 
ture of the other video decoder used in the sixth exam- 



ple. 

[0368] As shown in Figure 77, the video decoder 
includes VPTS detection means 1001 for detecting a 
VPTS indicating the reproduction time of the video sig- 

5 nal multiplexed as the compression video signal, video 
extension means 1002 for extending the MPEG com- 
pression video stream, reference time signal generation 
means 1004 for generating a reference time signal, and 
video reproduction timing control means 1003 for com- 

10 paring the reference time signal and the VPTS and skip- 
ping or repeating the video reproduction on a frame-by- 
frame basis when the comparison result exceeds the 
threshold value and also for outputting a horizontal syn- 
chronization signal and a vertical synchronization signal 

15 for the picture reproduced. 

[0369] As shown in Figure 78. the other video decoder 
includes VPTS detection means 1101 for detecting a 
VPTS indicating the reproduction time of the video sig- 
nal multiplexed as the compression video signal, video 

20 extension means 1102 for extending the MPEG com- 
pression video stream, reference time signal generation 
means 1104 for generating a reference time signal, and 
video reproduction timing control means 1003 for com- 
paring the reference time signal and the VPTS and skip- 

25 ping or repeating the video reproduction on a frame-by- 
frame basis when the comparison result exceeds the 
threshold value, for outputting a horizontal synchroniza- 
tion signal and a vertical synchronization signal for the 
picture reproduced, and also reproducing the extended 

30 video signal in synchronization with the horizontal/verti- 
cal synchronization signals. 

[0370] The video decoders are connected to each 
other so that the horizontal synchronization signal and 
the vertical synchronization signal output from the video 
35 decoder in Figure 77 are sent to the video decoder in 
Figure 78. 

[0371 ] In the optical disk reproduction apparatus in the 
sixth example having the above-described structure, the 
reference time signal generated by each video decoder 

40 is corrected with an APTS, and the video reproduction 
timing control means of each video decoder maintains 
the difference between each reference time signal and 
each VPTS to be equal to or less than the threshold 
value. Thus, the right-eye picture and the left-eye pic- 

45 ture can be synchronized with one another on a frame- 
by-frame basis. By using the horizontal and vertical syn- 
chronization signals output by one of the video decoder 
as the horizontal and the vertical synchronization sig- 
nals of the other video decoder, two pictures can be 

so reproduced in synchronization on a pixel-by-pixel basis. 
[0372] In the sixth example, compression video sig- 
nals obtained from a 3D video signal are used and 
divided into the right-eye and left-eye signals. Alterna- 
tively, for example, an original video signal having a first 

55 resolution is divided in a vertical and/or horizontal direc- 
tion into at least two video signals including a first video 
signal and a second video signal having a second reso- 
lution which is lower than the first resolution. The resurt- 
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ant signals are compressed to be used. Thus, a plurality 
of video signals in synchronization with one another on 
a pixel-by-pixel basis can be obtained as from a 3D 
video signal. By synthesizing such resultant signals, the 
clear original video signal having the original resolution 5 
is reproduced. 

(Example 7) 

[0373] The seventh example relates to an optical disk 
reproduction apparatus for extending one compression 
video signal and two compression audio signals and 
reproducing the signals simultaneously. 
[0374] Figure 81 shows a data structure of the optical 
disk used in the seventh example. 
[0375] Two audio signals D and E are compressed to 
obtain compression audio streams D and E. A video sig- 
nal is compressed to obtain a compression video 
stream. 

[0376] The compression audio streams D and E and 
the compression video stream are packeted in units of 2 
kB into audio packets and video packets. A packet 
header of each packet includes a stream ID for indicat- 
ing which of the compression audio streams D and E 
and the compression video stream is stored, and the 
APTS and VPTS. 

[0377] Figure 79 is a block diagram of the reproduc- 
tion apparatus in the sixth example. 
[0378] The reproduction apparatus has a generally 
similar structure to that in Figure 68. The audio decoder 
541 has the same structure as that shown in Figure 69, 
and the video decoder 531 has the same structure as 
that shown in Figure 65. The audio decoder 591 has the 
same structure as that shown in Figure 80. 
[0379] Reference numeral 590 represents a buffer 
memory for temporarily storing the compression audio 
signal like the buffer memory 540. Reference numeral 
592 represents a speaker for reproducing the audio sig- 
nal. 

[0380] Figure 80 shows a structure of the audio 
decoder 591 . The audio decoder 509 includes APTS 
detection means 1 201 for detecting an APTS stored in a 
packet header of the audio packet, audio extension 
means 1202 for extending the compression audio 
stream, and audio reproduction timing control means 
1203 for comparing the reference time signal and the 
APTS and skipping or repeating the audio reproduction 
on an audio frame-by-audio frame basis when the com- 
parison result exceeds the threshold value. 
[0381 ] A reproduction operation in the seventh exam- 
ple will be described. 

[0382] The operation until the signal read from the 
optical disk 501 is input to the division means 505 is 
similar to that in the other examples. 
[0383] The data read from the buffer memory 504 is 
divided by the division means 505 into a compression 
video signal, the compression audio signal D and the 
compression audio signal E, and output. The division 



means 505 identifies which of the compression video 
signal, the compression audio signal D and the com- 
pression audio signal E is stored in each packet with the 
packet ID in the packet header of the packeted data, 
and determines the destination based on the identifica- 
tion result. 

[0384] The divided compression video signal, the 
compression audio signal D and compression audio sig- 
nal are temporarily stored in buffer memories 530, 540 
and 590 respectively. 

[0385] The video decoders reads data from the buffer 
memory 530, extends the compression video signal and 
outputs the signal as a video signal to a monitor 532. 
The audio decoders 541 and 591 read data from the 
buffer memories 540 and 590, extend the compression 
audio signals and output the signals as audio signals 
through the speakers 542 and 592. 
[0386] The reference time signal generated by the ref- 
erence time signal generation means 506 is corrected 
by an APTS#D detected by the audio decoder 541 . 
[0387] In the audio decoder 591, an APTS#E is 
detected by the APTS detection means 1201 and the 
compression audio signal E is extended by the audio 
extension means 1202. The audio reproduction timing 
control means 1203 receives the extended audio signal 
output from the audio extension means 1202, the refer- 
ence time signal, and the APTS#E from the APTS 
detection means 1201, compares the reference time 
signal and the APTS#E. When the difference between 
the reference time signal and the APTS#E exceeds the 
threshold value, the audio reproduction timing control 
means 1203 controls the audio reproduction timing so 
that the difference is equal to or less than the threshold 
value. 

[0388] In the seventh example, 32 msec is used as the 
threshold value. The video reproduction timing control 
means 1203 performs the following. 

(reference time signal- APTS#E)>32 msec.:1 audio 
frame is skipped. 

(reference time signal- APTS#E)<-32 msec.:1 audio 
frame is repeated. 

[0389] The operation of the video decoder 531 for 
extending the compression video signal and correction 
performed when the difference between the reference 
time signal and the VPTS exceeds the threshold value 
are similar to those in the second example. 
[0390] In the seventh example, due to the precision 
error of the crystal oscillator used in the reference time 
signal generation means 506. the video decoder 531, 
and the audio decoders 541 and 591 ; the audio decod- 
ers 541 and 591 are slower and the video decoder 531 
is faster in terms of extension and reproduction with 
respect to the reference time signal. Unless reproduc- 
tion timing is corrected, the reproduced video signals 
are out of synchronization. 

[0391] Figure 82 is a timing diagram of video repro- 
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duction in the seventh example. Part (a) of Figure 82 
shows the APTS#D with respect to reproduction time t 
Part (b) shows the reference time signal, part (c) shows 
APTS#E, at which the compression audio signal E to be 
extended by the audio decoder 531 is to be reproduced, 5 
and part (d) shows the VPTS, at the compression video 
signal to be extended by the video decoder 531 is to be 
reproduced. The reference time signal is corrected 
using the APTS#D when APTS#D shows ta3 and ta4. 
The reference time signal is reset to ta3 and ta4 at the w 
respective time. 

[0392] The audio decoder 591 continues extension 
and reproduction of the compression audio signal E, 
and the difference between the VPTS#E and the refer- 
ence time signal exceeds 32 msec, as the threshold is 
value at T10. Accordingly, the video reproduction timing 
control means 1 203 of the audio decoder 591 skips one 
audio frame which is originally to be reproduced to cor- 
rect the reproduction timing so that the difference 
between the VPTS#E and the reference time signal is 20 
equal to or less than the threshold value. 
[0393] The difference between the VPTS and the ref- 
erence time signal exceeds -33 msec, as the threshold 
value at T1 1 and T12. Accordingly, the video reproduc- 
tion timing control means of the video decoder 531 25 
reproduces one frame in repetition which has been 
already reproduced at the respective time to correct the 
reproduction timing so that the difference between the 
VPTS and the reference time signal is equal to or less 
than the threshold value. 30 
[0394] As described above, in the seventh example, 
when the difference between the reference time signal 
and the VPTS#E detected by the audio decoder 591 
exceeds the threshold value, the video reproduction tim- 
ing control means of the audio decoder performs cor- 35 
rection so that difference between the reference time 
signal and the APTS#E does not exceed the threshold 
value. In this manner, each audio signal and the picture 
can be synchronized with one another. 

40 

(Example 8) 

[0395] In the eighth example, the clock for performing 
extension is changed for audio reproduction control. 
[0396] The overall structure and operation of the 45 
reproduction apparatus in the eighth example are gen- 
erally similar to those of the optical disk reproduction 
apparatus in the seventh example, but the operation of 
audio reproduction timing control performed when the 
reference time signal and the APTS#E exceeds the so 
threshold value is different from that of the seventh 
example. With reference to Figure 83 and 84, audio 
reproduction timing control used in the eighth example 
will be described. 

[0397] Figure 83 shows an operation when the differ- ss 
ence between the APTS#E and the reference timing 
signal exceeds 32 msec. Which is the threshold for the 
audio reproduction. Part (a) of Figure 83 shows the ref- 



erence time signal with respect to reproduction time t. 
Part (b) shows the APTS#E, and part (c) shows the 
clock frequency at which the audio decoder 591 per- 
forms extension and reproduction. Ordinary extension 
and reproduction are performed by dock to having a fre- 
quency which is 384 times the sampling frequency fs of 
the audio signal. The difference between the APTS#E 
and the reference time signal exceeds 32 msec, at time 
T1 1 , and accordingly, audio reproduction control means 
switches the clock fO to ff1. The frequency of clock f1 is 
higher by 10% than the frequency of clock fO. Extension 
performed with clock f 1 proceeds faster than extension 
performed with clock fO by 10%. With clock 11. the 
extension is performed for 320 msec, from the point 
where the difference between the APTS#E and the ref- 
erence time signal exceeds 32 msec. Which is the 
threshold value. Thus, the reproduction timing is cor- 
rected so that the difference between the APTS#E and 
the reference time signal is equal to or less than the 
threshold value. 

[0398] Figure 84 shows an operation when the differ- 
ence between the APTS#E and the reference timing 
signal exceeds -32 msec, which is the threshold for the 
audio reproduction. Part (a) of Figure 83 shows the ref- 
erence time signal with respect to reproduction time t. 
Part (b) shows the APTS#E, and part (c) shows the 
clock frequency at which the audio decoder 591 per- 
forms extension and reproduction. 
[0399] The difference between the APTS#E and the 
reference time signal exceeds -32 msec, at time T12, 
and accordingly, audio reproduction control means 
switches the clock fO to f2. The frequency of clock f2 is 
lower by 10% than the frequency of dock fO. Extension 
performed with clock f2 proceeds more slowly than 
extension performed with clock fO by 10%. With clock f 2, 
the extension is performed for 320 msec, from the point 
where the difference between the APTS#E and the ref- 
erence time signal exceeds -32 msec, which is the 
threshold value. Thus, the reproduction timing is cor- 
rected so that the difference between the APTS#E and 
the reference time signal is equal to or less than the 
threshold value. 

[0400] As described above, when the difference 
between the APTS#E and the reference time signal 
exceeds the threshold value for the audio reproduction, 
the clock by which the signal is extended is changed so 
that the extension is performed at a higher speed or 
lower speed than the normal speed. By such an opera- 
tion, the reproduction timing is controlled so that the dif- 
ference between the APTS#E and the reference time 
signal is equal to or less than the threshold value. Thus, 
the audio signals and the video signal can be repro- 
duced in synchronization with no unnaturalness in the 
audio output. 

[0401] In the eighth example, the frequency of the 
dock is changed by 10%. Needless to say, a more nat- 
ural audio signal is obtained by reducing the clock less 
or gradually. 
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[0402] In the seventh and eighth examples, the refer- 
ence time signal is corrected using the APTS#D. Alter- 
natively, the video decoder shown in Figure 73 can be 
used, in which case the VPTS output from the video 
decoder can be used for correction. 5 
[0403] The present invention has been described by 
way of specific examples. 

[0404] The comparison between the reference time 
signal and the VPTS or APTS, control of the reproduc- 
tion time, correction of the reproduction timing can be 10 
performed by a microcomputer which controls the 
entirety of the reproduction apparatus. 
[0405] In the above examples, the present invention is 
applied to optical disk reproduction devices. The 
present invention is also applicable to a reproduction 15 
apparatus for extending signals supplied through com- 
munication networks and digital satellite broadcasting 
as compression signals. 

INDUSTRIAL APPLICABILITY 20 

[0406] A basic video signal and an interpolation signal 
are divided into frames each having 1 GOP or more and 
subjected to interleaving alternately to be recorded on 
the optical disk as interleave blocks 54 and 55. From 25 
such an optical disk, a progressive/3 D reproduction 
apparatus reproduces both information in the interleave 
block for the odd field (right eye) and information in the 
interleave block for the even field (left eye). Thus, a pro- 
gressive/3D picture is obtained. A non-progressive/3D 30 
reproduction apparatus reproduces information in the 
interleave block of only odd field (right eye) or even field 
(left eye) by track jump. Thus, a complete two-dimen- 
sional picture is obtained. Thus, compatibility is real- 
ized. 35 
[0407] Especially, a progressive/3D picture arrange- 
ment information file and a progressive/3 D picture iden- 
tifier are recorded on the optical disk. Accordingly, the 
location of the progressives is easily determined. 
Therefore, two ordinary interlace signals can be made to 
into a progressive signal. Furthermore, it can be 
avoided that pictures for the right eye and left eye of dif- 
ferent contents are output on the 3D TV. 
[0408] In a 3D reproduction apparatus, a pointer used 
for two-dimensional display is used when an 3D identi- 45 
f ier is available to change the access process. Thus, 3D 
pictures can be continuously displayed. Moreover, a 3D 
reproduction apparatus is realized without changing the 
two-dimensional format. 

[0409] According to the synchronization method of the so 
present invention, a plurality of video signals or a plural- 
ity of audio signals to be simultaneously reproduced are 
extended in synchronization for reproduction. 
[041 0] In the embodiment where a horizontal synchro- 
nization signal and a vertical synchronization signal ss 
which are output from one video decoder are used as 
the horizontal synchronization signal and the vertical 
synchronization signal of another video decoder, syn- 



chronization on a pixel -by-pixel basis is realized even 
when, for example, a plurality of compression video sig- 
nals are extended and the extended signals are synthe- 
sized into a 3D picture or a high resolution picture. 
[041 1 ] In a reproduction apparatus in which the refer- 
ence time signal is corrected using an APTS detected 
by an audio decoder and the video output timing is con- 
trolled so that the VPTS matches the corrected refer- 
ence time signal, an audio signal and a plurality of video 
signals are synchronized for reproduction with no 
unnaturalness in the audio output. 
[041 2] In a reproduction apparatus in which the audio 
output timing is controlled by changing an extension 
clock, audio and video signals are synchronized for 
reproduction with no unnaturalness in the audio output 
with no interruption or pause in the audio signal. 

Claims 

1. An optical disk reproduction apparatus for repro- 
ducing data in an optical disk, in which the optical 
disk has at least a first video stream corresponding 
to a first signal source and a second video stream 
corresponding to a second signal source recorded 
on the optical disk, the first video stream includes a 
plurality of first interleave units and the second 
video stream includes a plurality of second inter- 
leave units, each of the plurality of first interleave 
units is m-| pieces of GOPs, each of the plurality of 
second interleave units is m 2 pieces of GOPs, the 
first interleave units and the second interleave units 
are recorded on the optical disk in a prescribed 
order, each of the plurality of first interleave units 
corresponds to first time information related to 
reproduction time, and each of the plurality of sec- 
ond interleave units corresponds to second time 
information related to reproduction time, the optical 
disk reproduction apparatus comprising: 

a reproduction section for reproducing a signal 
recorded on the optical disk; 
a division section for dividing the reproduced 
signal into the plurality of first interleave units 
included in the first video stream and the plural- 
ity of second interleave units included in the 
second video stream; 

a decoding section for decoding the first inter- 
leave units and the second interleave units; 
and 

an output section for outputting the decoded 
first interleave unit and the decoded second 
interleave unit substantially simultaneously 
based on the first time information correspond- 
ing to the first interleave unit and the second 
time information corresponding to the second 
interleave unit, 

wherein nrij and rrig are each an integer of one 
or more. 
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2. An optical disk reproduction apparatus according to 
claim 1 , further comprising a synthesis section for 
synthesizing the decoded first interleave unit and 
the decoded second interleave unit. 

3. An optical disk reproduction apparatus according to 
claim 2, wherein: 

a high resolution video signal includes a low 
resolution component and a high resolution 
component, 

the first video stream represents the low reso- 
lution component, 

the second video stream represents the high 
resolution component, and 
the synthesis section synthesizes the decoded 
interleave unit and the decoded second inter- 
leave unit to generate the high resolution video 
signal. 

4. An optical disk reproduction apparatus according to 
claim 2, wherein: 

a three-dimensional video signal includes a 

right-eye signal and a left-eye signal, 

the first video stream represents the right-eye 

signal, 

the second video stream represents the left- 
eye signal, and 

the synthesis section synthesizes the decoded 
first interleave unit and the decoded second 
interleave unit, thus generating the three- 
dimensional video signal. 

5. An optical disk reproduction apparatus according to 
claim 2, wherein the synthesis section performs a 
prescribed first calculation to the first interleave unit 
and the second interleave unit, performs a pre- 
scribed second calculation to the first interleave unit 
and the second interleave unit, and synthesizes a 
result of the prescribed first calculation and a result 
of the prescribed second calculation, thus generat- 
ing a synthesis signal. 

6. An optical disk reproduction apparatus according to 
claim 5, wherein the prescribed first calculation 
includes a sum calculation of the first interleave unit 
and the second interleave unit, and the prescribed 
second calculation includes a difference calculation 
of the first interleave unit and the second interleave 
unit. 

7. An optical disk reproduction apparatus according to 
claim 6, wherein the first calculation further 
includes a calculation of adding a first value to a 
result of the sum calculation, and the second calcu- 
lation further includes a calculation of adding a sec- 
ond value to a result of the difference calculation. 



8. An optical disk reproduction apparatus according to 
claim 6, wherein the synthesis section assigns the 
result of the first calculation to picture data of an 
Sth line and assigns the result of the second calcu- 

5 lation to picture data of an (S+1)th line, and S is an 
integer 

9. An optical disk reproduction apparatus according to 
claim 8, for reproducing an optical disk obtained by 

w performing a first division calculation and a second 
division calculation on a Pin frame of an input video 
signal using video data of at least a 2Q'th line and a 
(2Q+1)th line of the input video signal, locating a 
result of the first division calculation in a 2Q'th line 
75 of the first video stream, locating a result of the sec- 
ond division calculation in a 2Q'th line of the second 
video stream, performing the first division calcula- 
tion and the second division calculation on a 
(P+1)th frame of the input video signal using video 
20 data of at least the 2Q1h line and the (2Q+1)th line 
of the input video signal, locating a result of the first 
division calculation in a (2Q+1)th line of the first 
video stream, and locating a result of the second 
division calculation in a (2Q+1)th line of the second 
25 video stream, 

wherein the synthesis section performs the 
sum calculation and the difference calculation of a 
video signal of a 2Q'th or a 2(Q+1 )th line of a 
decoding signal of the first video stream and a 
30 video signal of the 2Q'th or the (2Q+1)th line of the 
second video stream, thus generating a synthesis 
signal which has a result of the sum calculation as 
a video signal of a 2R1h line and a result of the dif- 
ference calculation as a video signal of a (2R+1)th 
35 line; and R and Q are each an integer, and R has a 
specific relationship with Q. 

10. An optical disk reproduction apparatus according to 
claim 6, wherein the synthesis section generates a 

40 synthesis signal using color information of the first 
video stream but without using color information of 
the second video stream. 

1 1 . An optical disk reproduction apparatus according to 
45 claim 6, wherein: 

the high resolution video signal includes a low 
resolution component and a high resolution 
component, and 
so the synthesis section transforms a parameter 

of the sum calculation and the difference calcu- 
lation based on filter identification information 
which represents a division filter parameter of 
the high resolution component and the low res- 
55 olution component. 

12. An optical disk reproduction apparatus according to 
claim 5, wherein: 
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a high resolution video signal includes a low 
resolution component and a high resolution 
component, 

the first video stream represents the low reso- 
lution component, 

the second video stream represents the high 
resolution component, and 
the synthesis section generates a synthesis 
signal using color information of the first video 
stream but without using color information of 
the second video stream. 

1 3. An optical disk reproduction apparatus according to 
claim 5, wherein: 

a high resolution video signal includes a low 
resolution component and a high resolution 
component. 

the first video stream represents the low reso- 
lution component, 

the second video stream represents the high 
resolution component, and 
the synthesis section alters a calculation 
parameter in accordance with division informa- 
tion which represents a division parameter 
when the high resolution signal is separated 
from the low resolution signal, the division infor- 
mation being reproduced from the optical disk. 

14. An optical disk reproduction apparatus according to 
claim 13, wherein a filter constant is used as the 
calculation parameter. 

15. An optical disk reproduction apparatus according to 
claim 5, wherein the synthesis section synthesizes 
the result of the prescribed first calculation and the 
result of the prescribed second calculation in a ver- 
tical direction. 

16. An optical disk reproduction apparatus according to 
claim 5, wherein the synthesis section synthesizes 
the result of the prescribed first calculation and the 
result of the prescribed second calculation in a hor- 
izontal direction. 

17. An optical disk reproduction apparatus according to 
claim 5, wherein the synthesis section transforms 
the synthesis signal into a progressive signal. 

18. An optical disk reproduction apparatus according to 
claim 2, wherein the decoding section performs 
decoding using a motion compensation signal of 
the first video stream as a motion compensation 
signal of the second video stream. 

1 9. An optical disk reproduction apparatus according to 
claim 2, further comprising video identification 
means for identifying identification information 



which indicates that a high resolution video signal 
or a three-dimensional video signal are recorded, 
wherein: 

5 when the video identification means identifies 

the identification information, the optical disk 
reproduction apparatus optionally reproduces 
both the first interleave unit and the second 
interleave unit, and 

10 the decoding section and the synthesis section 

respectively decodes and synthesizes the high 
resolution video signal and/or the three-dimen- 
sional video signal. 

is 20. An optical disk reproduction apparatus according to 
claim 19, wherein, when the video identification 
means does not reproduce the identification infor- 
mation, the optical disk reproduction apparatus 
optionally reproduces only the first interleave unit. 

20 

21 . An optical disk reproduction apparatus according to 
claim 20, wherein, when the video identification 
means does not reproduce the identification infor- 
mation, the optical disk reproduction apparatus 
25 optionally reproduces only the first interleave unit 
and outputs the first interleave unit with the number 
of scanning lines of the first signal source being 
increased. 

30 22. An optical disk reproduction apparatus according to 
claim 1 , for reproducing an optical disk having first 
reproduction information indicating that information 
for reproducing the first interleave unit is present 
and information for reproducing the second inter- 

35 leave unit is absent, second reproduction informa- 
tion indicating that information for reproducing the 
first interleave unit and information for reproducing 
the second interleave unit are both present, identifi- 
cation information indicating that the first reproduc- 

40 tion information is valid, and high resolution video 
signal/three-dimensional video signal recording 
identification information indicating that high resolu- 
tion or three-dimensional video signal is divided into 
the first video stream and the second video stream, 

45 wherein, when the high resolution video sig- 

nal/three-dimensional video signal recording identi- 
fication information is detected, the optical disk 
reproduction apparatus optionally reproduces both 
the first interleave unit and the second interleave 

so unit in accordance with the second reproduction 
information. 

23. An optical disk reproduction apparatus according to 
claim 22, wherein the optical disk reproduction 
55 apparatus reproduces the second reproduction 
information to acquire starting position information 
of an immediately subsequent interleave unit of a 
specific interleave unit in each video stream, and 
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thus reproduces both the first interleave unit and 
the second interleave unit. 

24. An optical disk reproduction apparatus according to 
claim 22, wherein, when the high resolution video s 
signal/three-dimensional video signal recording 
identification information is not detected, the optical 
disk reproduction apparatus reproduces the first 
interleave unit in accordance with the first reproduc- 
tion information. 10 

25. An optical disk reproduction apparatus according to 
claim 1 , wherein the optical disk stores n pieces of 
video streams respectively corresponding to n 
pieces of signal sources, and is 



26. An optical disk reproduction apparatus according to 
claim 25. wherein the division section includes a 25 
buffer section for buffering the i pieces of video 
streams, and the buffer section has a total capacity 

of 1 1 02x(M ) kbyte or more. 

27. An optical disk reproduction apparatus according to 30 
claim 26, wherein i=2. 

28. An optical disk reproduction apparatus according to 
claim 1 , wherein at least the first video stream and 
the second video stream are decoded simultane- 35 
ously, and a one-screen video signal having the first 
video stream located on a first area and the second 
video stream located on a second area is output. 

29. An optical disk reproduction apparatus according to 40 
claim 28. wherein the first area and the second area 
are different from each other in a horizontal direc- 
tion. 

30. An optical disk reproduction apparatus according to 45 
claim 29, wherein the synthesis section includes a 
line memory. 

31 . An optical disk reproduction apparatus according to 
claim 28, wherein information displayed on the first so 
area is enlarged or reduced in accordance with an 
externally input instruction signal. 

32. An optical disk reproduction apparatus according to 
claim 31 , wherein the synthesis section includes a 55 
frame memory. 

33. An optical disk reproduction apparatus according to 



claim 31 , wherein the first area is enlarged and the 
second area is reduced in accordance with an 
externally input instruction signal. 

34. An optical disk reproduction apparatus according to 
claim 28, wherein a sub picture of either one of the 
first video stream and the second video stream is 
displayed. 

35. An optical disk reproduction apparatus according to 
claim 28, wherein a frame memory is used to con- 
tinuously display the first video stream on the first 
area, n pieces of display areas are provided to dis- 
continuously display an n'th stream in an nth area, 
and n is an integer of one or more. 

36. An optical disk reproduction apparatus according to 
claim 28, wherein only an audio signal of the first 
video stream is output. 

37. An optical disk reproduction apparatus according to 
claim 28, wherein an audio signal of the first video 
stream and an audio signal of the second video 
stream are output, and the audio level of the second 
video stream is lowered. 

38. An optical disk reproduction apparatus according to 
claim 1, wherein the output section outputs the first 
video stream as a right-eye signal and the second 
video stream as a left-eye signal. 

39. An optical disk reproduction apparatus according to 
claim 38, wherein the output section outputs the 
first video stream to a right-eye video output section 
and the second video stream to a left-eye video out- 
put section. 

40. An optical disk reproduction apparatus according to 
claim 39, wherein the output section outputs a syn- 
chronization signal for three-dimensional specta- 
cles, the synchronization signal including an 
identification signal of the left-eye signal and the 
right-eye signal. 

41 . An optical disk reproduction apparatus according to 
claim 39. wherein the output section outputs the 
three-dimensional video only when a three-dimen- 
sional video output instruction is issued. 

42. An optical disk reproduction apparatus according to 
claim 39, wherein, while an area storing a three- 
dimensional video signal is reproduced, the output 
section outputs a display to a display section that 
the three-dimensional video signal is being repro- 
duced. 

43. An optical disk reproduction apparatus according to 
claim 38. wherein the output section includes a mix- 



the optical disk reproduction apparatus further 
comprises a selection section for selecting i 
pieces of video streams including the first video 
stream and the second video stream from the n 20 
pieces of video streams, and n and i are each 
an integer of two or more. 
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ture synthesis section for synchronizing the time 
information of the first video stream and the time 
information of the second video stream, mixes the 
first and second video streams on a field-by-field 
basis or on a frame-by-frame basis, and outputs the 
first and second video streams alternately. 

44. An optical disk reproduction apparatus according to 
claim 43, wherein the output section includes a 
three-dimensional switch signal section for output- 
ting a signal for switching the left-eye signal and the 
right-eye signal. 

45. An optical disk reproduction apparatus according to 
claim 43, wherein the mixture synthesis section 
identifies the signal is a three-dimensional video 
signal and mixes the first video stream and the sec- 
ond video stream only when a three-dimensional 
video output instruction is issued. 

46. An optical disk reproduction apparatus according to 
claim 43, wherein, when a non three-dimensional 
video signal is output while an area storing a three- 
dimensional video signal is reproduced, the output 
section provides an output video signal with a dis- 
play that the three-dimensional video signal is 
being reproduced. 

47. An optical disk reproduction apparatus according to 
claim 38, wherein, when a non three-dimensional 
video signal is output while an area storing a three- 
dimensional video signal is reproduced, the output 
section provides an output video signal with a dis- 
play that the three-dimensional video signal is 
being reproduced. 

48. An optical disk reproduction apparatus according to 
claim 2, for receiving a compressed video stream 
obtained by compressing each of a plurality of 
video signals to be reproduced in synchronisation 
and a plurality of compressed video signals 
obtained by multiplexing video reproduction time 
information indicating the time to reproduce the 
video signal and then performing extension and 
reproduction, the optical disk reproduction appara- 
tus further comprising: 

reference time signal generation means for 
generating a reference time signal; and 
a plurality of video extension reproduction 
means for extending the compressed video 
stream and controlling the reproduction time of 
the video signal which has been extended in 
accordance with the difference between the 
reference time signal and the video reproduc- 
tion time information, 

wherein the reference time signals of the plu- 
rality of video extension reproduction means 



are compensated for at substantially the same 
time using same information. 

49. An optical disk reproduction apparatus according to 
5 claim 48, further comprising at least one audio sig- 
nal extension reproduction means for receiving a 
compressed audio stream obtained by compress- 
ing an audio signal to be reproduced in synchroni- 
sation with the video signals and at least one 
io compressed audio signal obtained by multiplexing 
audio reproduction time information indicating the 
time to reproduce the audio signal, then extending 
the compressed audio stream, and outputting the 
audio reproduction time information, 
15 wherein the reference time signal is com- 

pensated for by using the audio reproduction time 
information output by the audio extension reproduc- 
tion means. 

20 50. An optical disk reproduction apparatus according to 
claim 48, wherein at least one of the plurality of 
video extension reproduction means outputs video 
reproduction time information, and the reference 
time signal is compensated for by using the video 

25 reproduction time information output by at least 
ones of the plurality of the video extension repro- 
duction means. 

51 . An optical disk reproduction apparatus according to 
30 claim 48, wherein the video extension reproduction 

means skip- reproduce or repeat-reproduce a frame 
of the video signal to control the reproduction time. 

52. An optical disk reproduction apparatus according to 
35 claim 48, wherein at least one of the plurality of the 

video extension reproduction means outputs a hor- 
izontal synchronization signal and a vertical syn- 
chronization signal of the video signal, thus to 
synchronize video reproduction performed by 
40 another video extension reproduction means to the 
horizontal synchronization signal and the vertical 
synchronization signal. 

53. An optical disk reproduction apparatus for repro- 
45 ducing an optical disk, in which the optical disk 

stores at least one audio stream, the audio stream 
includes a plurality of compressed audio signals, 
and each of the plurality of compressed audio sig- 
nals corresponds to time information related to 
so reproduction time, the optical disk reproduction 
apparatus comprising: 

a reproduction section for reproducing a signal 
recorded on the optical disk; 
55 a division section for dividing the reproduced 

signal into a plurality of compressed audio sig- 
nals included in the audio stream; 
reference time signal generation means for 
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plurality of second interleave units corresponds to 
second time information related to reproduction 
time. 

5 59. An optical disk according to claim 58, wherein: 



generating a reference time signal; 

an extension section for extending the plurality 

of audio signals; and 

an output section for controlling timing for out- 
putting the extended audio signal based on the 
difference between the time information corre- 
sponding to each of the plurality of compressed 
audio signals and the reference time signal. 



54. An optical disk reproduction apparatus according to 
claim 53. wherein at least one of a plurality of output 
sections outputs audio reproduction, and the refer- 
ence time signal is compensated for by using the 
audio reproduction time information output by the at 
least one of a plurality of output sections. 

55. An optical disk reproduction apparatus according to 
claim 53, further comprising at least one video sig- 
nal extension reproduction means for receiving a 
compressed video stream obtained by compress- 
ing a video signal to be reproduced in synchroniza- 
tion with the audio signal and at least one 
compressed video signal obtained by multiplexing 
video reproduction time information indicating the 
time to reproduce the video signal, then extending 
the compressed video stream, and outputting the 
video reproduction time information, 

wherein the reference time signal is com- 
pensated for using the video reproduction time 
information output by the video extension reproduc- 
tion means. 

56. An optical disk reproduction apparatus according to 
claim 53, wherein the audio stream is obtained by 
compressing an audio signal every time unit 
referred to as audio frame, and the output section 
skip-reproduces or pauses the audio frame to con- 
trol the reproduction time. 

57. An optical disk reproduction apparatus according to 
claim 53, wherein the output section changes a fre- 
quency of a clock for performing extension repro- 
duction to control the reproduction time. 

58. An optical disk having at least a first video stream 
corresponding to a first signal source and a second 
video stream corresponding to a second signal 
source recorded on the optical disk, wherein the 
first video stream includes a plurality of first inter- 
leave units and the second video stream includes a 
plurality of second interleave units, each of the plu- 
rality of first interleave units is m-i pieces of GOPs, 
each of the plurality of second interleave units is rr^ 
pieces of GOPs, the first interleave units and the 
second interleave units are recorded on the optical 
disk in a prescribed order, each of the plurality of 
first interleave units corresponds to first time infor- 
mation related to reproduction time, and each of the 



a high resolution video signal includes a low 
resolution component and a high resolution 
component, 

the first video stream recorded on the optical 
disk represents the low resolution component, 
and 

the second video stream recorded on the opti- 
cal disk represents the high resolution compo- 
nent. 

60. An optical disk according to claim 59, wherein: 

the low resolution component of the first video 
stream recorded on the optical disk is gener- 
ated by a sum calculation of specific two or 
more signals of the high resolution signal, and 
the high resolution component of the second 
video stream recorded on the optical disk is 
generated by a difference calculation of spe- 
cific two or more signals of the high resolution 
signal. 

61. An optical disk according to claim 60, wherein the 
low resolution component of the first video stream 
recorded on the optical disk and the high resolution 
component of the second video stream recorded on 
the optical disk are generated as a result of division 
performed in a vertical direction by video signal divi- 
sion means. 

62. An optical disk according to claim 61 , wherein: 

the first video stream has, in a 2Qth line, a 
result of a first division calculation performed 
on a Pth frame of an input video signal using 
video data of at least a 2Qlh line and a 
(2Q+1 )th line of the input video signal, 
the second video stream has, in a 2Q1h line, a 
result of a second division calculation per- 
formed on a P*th frame of the input video signal 
using video data of at least a 2Q'th line and a 
(2Q+1)th line of the input video signal, 
the first video stream has, in a (2Q+1)th line, a 
result of the first division calculation performed 
on a (P+1)th frame of the input video signal, 
the second video stream has, in a (2Q+1)th 
line, a result of the second division calculation 
performed on a (P+1)th frame of the input 
video signal, and 
P and Q are each an integer. 

63. An optical disk according to claim 59, wherein the 
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low resolution component of the first video stream 
recorded on the optical disk and the high resolution 
component of the second video stream recorded on 
the optical disk are generated as a result of division 
performed in a vertical direction by video signal divi- 
sion means. 

64. An optical disk according to claim 59, wherein the 
first video stream recorded on the optical disk and 
the second video stream recorded on the optical 
disk are generated by dividing a high resolution 
video signal in a horizontal direction by video signal 
division means, so that the first video stream has a 
horizontal low resolution component and the sec- 
ond video stream has horizontal high resolution 
component. 

65. An optical disk according to claim 64, on which 
overlapping field or frame signals are recorded in a 
video signal in an abbreviated encoded state, and 
an identifier is recorded indicating the abbreviated 
field or frame signal. 

66. An optical disk according to claim 59, on which 
identification information is recorded indicating a 
calculation parameter used for the division calcula- 
tion for dividing a video signal. 

67. An optical disk according to claim 59, wherein 
motion vector information of a video encoding sig- 
nal of the first video stream and motion vector infor- 
mation of a video encoding signal of the second 
video stream have an identical value. 

68. An optical disk according to claim 58. on which at 
least the first video stream and the second video 
stream are recorded while being encoded by a sub- 
stantially identical signal format. 

69. An optical disk according to claim 68, wherein the 
substantially identical signal format is obtained by 
encoding an NTSC, PAL or SEC AM signal. 

70. An optical disk according to claim 58, where inter- 
leave units corresponding to each of first through 
m'th streams are 1st through m'th interleave units, 
the optical disk has: 

first reproduction information including informa- 
tion for reproducing the first interleave unit but 
excluding information for reproducing the sec- 
ond interleave unit; 

second reproduction information including both 
information for reproducing the first interleave 
unit and information for reproducing the second 
interleave units; and 

an identifier for making the second reproduc- 
tion information valid. 



71. An optical disk according to claim 70, wherein 
reproduction information of one interleave unit 
includes leading position information of another 
interleave unit, wherein the another interleave unit 
5 belongs to the same stream as the one interleave 
unit and is the next closest interleave unit to the one 
interleave unit among interleave units having time 
information. 

io 72. An optical disk according to claim 71, on which 
reproduction information of the first interleave unit 
in a first table is recorded as the first reproduction 
information, reproduction information of the first 
interleave unit and the second interleave unit in a 
15 second table is recorded as the second reproduc- 
tion information, and an identifier is recorded indi- 
cating that the first table is valid. 

73. An optical disk according to claim 72, on which a 
20 table for seamless reproduction is recorded as the 
first table, a table for non-seamless reproduction is 
recorded as the second table, and an identifier is 
recorded indicating the seamless reproduction. 

25 74. An optical disk according to claim 58, wherein an 
encoded video signal for a right-eye signal of a 
three-dimensional video signal is used as at least 
the first video stream, and an encoded video signal 
for a left-eye signal of the three-dimensional video 

30 signal is used as at least the second video stream, 
an identifier being recorded on the optical disk indi- 
cating a recording area where the three-dimen- 
sional video signal is recorded. 

35 75. An optical disk according to claim 58, wherein an 
encoded video signal for a low resolution compo- 
nent of a high resolution video signal is used as at 
least the first video stream, and an encoded video 
signal for a high resolution component of the high 
40 resolution video signal is used as at least the sec- 
ond video stream, an identifier being recorded on 
the optical disk indicating a recording area where 
the high resolution video signal is recorded. 

45 76. An optical disk recording apparatus for recording a 
prescribed signal on an optical disk, wherein the 
prescribed signal includes at least a first video 
stream corresponding to a first signal source and a 
second video stream corresponding to a second 
so signal source, the first video stream includes a plu- 
rality of first interleave units and the second video 
stream includes a plurality of second interleave 
units, each of the plurality of first interleave units is 
pieces of GOPs. each of the plurality of second 
55 interleave units is rc^ pieces of GOPs, each of the 
plurality of first interleave units corresponds to first 
time information related to reproduction time, and 
each of the plurality of second interleave units cor- 
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responds to second time information related to 
reproduction time. 

77. An optical disk recording apparatus according to 
claim 76, further comprising video signal division 
means for dividing a high resolution video signal 
into a low resolution component and a high resolu- 
tion component, wherein: 

the first video stream recorded on the optical 
disk represents the low resolution component, 
and 

the second video stream recorded on the opti- 
cal disk represents the high resolution compo- 
nent. 

78. An optical disk recording apparatus according to 
claim 77, wherein the video signal division means 
generates the low resolution component by a sum 
calculation of specific two or more signals of the 
high resolution video signal and generates the high 
resolution component by a difference calculation of 
specific two or more signals of the high resolution 
video signal. 

79. An optical disk recording apparatus according to 
claim 78, wherein the video signal division means 
divides the video signal into a vertical low resolution 
component and a vertical high resolution compo- 
nent. 

80. An optical disk recording apparatus according to 
claim 79, wherein the video signal division means 
locates: 

a result of a first division calculation performed 
on a P'th frame of an input video signal using 
video data of at least a 2Q1h line and a 
(2Q+1 )th line of the input video signal in a 2Q1h 
line of the first video stream, 
a result of a second division calculation per- 
formed on a P'th frame of the input video signal 
using video data of at least a 2Q1h line and a 
(2Q+1)th line of the input video signal in a 2Q1h 
line of the second video stream, 
a result of the first division calculation per- 
formed on a (P+1)th frame of the input video 
signal in a (2Q+1)th line of the first video 
stream, and 

a result of the second division calculation per- 
formed on a (P+1)th frame of the input video 
signal in a (2Q+1)th line of the second video 
stream, 

P and Q being each an integer. 

81. An optical disk recording apparatus according to 
claim 77, wherein the video signal division means 
divides the high resolution video signal into a verti- 



cal low resolution component and a vertical high 
resolution component. 

82. An optical disk recording apparatus according to 
5 claim 77, wherein the video signal division means 

divides the high resolution video signal into the first 
video stream having a horizontal low resolution 
component and the second video stream having a 
horizontal high resolution component. 

w 

83. An optical disk recording apparatus according to 
claim 82, wherein overlapping field or frame signals 
in a video signal are recorded in an abbreviated 
encoded state, and the optical disk recording appa- 

15 ratus records an identifier indicating the abbrevi- 
ated field or frame signal. 

84. An optical disk recording apparatus according to 
claim 77, wherein the apparatus records identifica- 

20 tion information indicating a calculation parameter 
used for the division calculation for dividing a video 
signal. 

85. An optical disk recording apparatus according to 
25 claim 77, wherein a motion vector detection section 

of a video encoding section uses a motion vector 
detection signal of one of the streams to encode the 
other stream. 

30 86. An optical disk recording apparatus according to 
claim 76, wherein at least the first video stream and 
the second video stream are encoded by a sub- 
stantially identical signal format. 

35 87. An optical disk recording apparatus according to 
claim 86, wherein the substantially identical signal 
format is obtained by encoding an NTSC, PAL or 
SECAM signal. 

40 88. An optical disk recording apparatus according to 
claim 76, wherein interleave units corresponding to 
each of first through m'th streams are 1 st through 
m'th interleave units, the optical disk recording 
apparatus records: 

45 

first reproduction information including informa- 
tion for reproducing the first interleave unit but 
excluding information for reproducing the sec- 
ond interleave unit; 
so second reproduction information including both 

information for reproducing the first interleave 
unit and information for reproducing the second 
interleave units; and 

an identifier for making the second reproduc- 
55 tion information valid. 

89. An optical disk recording apparatus according to 
claim 88. wherein reproduction information of one 
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interleave unit includes leading position information 
of another interleave unit, wherein the another 
interleave unit belongs to the same stream as the 
one interleave unit and is the next closest interleave 
unit to the one interleave unit among interleave 5 
units having time information. 

90. An optical disk recording apparatus according to 
claim 89, wherein the apparatus records reproduc- 
tion information of the first interleave unit in a first 10 
table as the first reproduction information, repro- 
duction information of the first interleave unit and 
the second interleave unit in a second table as the 
second reproduction information, and an identifier 
indicating that the first table is valid. 15 

91. An optical disk recording apparatus according to 
claim 90, which records a table for seamless repro- 
duction as the first table, a table for non-seamless 
reproduction as the second table, and an identifier 20 
indicating the seamless reproduction. 

92. An optical disk recording apparatus according to 
claim 76, wherein an encoded video signal for a 
right-eye signal of a three-dimensional video signal 25 
is used as at least the first video stream, and an 
encoded video signal for a left-eye signal of the 
three-dimensional video signal is used as at least 
the second video stream, an identifier being 
recorded on the optical disk indicating a recording 30 
area where the three-dimensional video signal is 
recorded. 

93. An optical disk recording apparatus according to 
claim 76, wherein an encoded video signal for a low 35 
resolution component of a high resolution video sig- 
nal is used as at least the first video stream, and an 
encoded video signal for a high resolution compo- 
nent of the high resolution video signal is used as at 
least the second video stream, an identifier being 40 
recorded on the optical disk indicating a recording 
area where the high resolution video signal is 
recorded. 

94. An optical disk according to claim 75. having a 45 
result of a specific calculation of the identification 
information and disk attribute information inherent 

in a master disk of the optical disk or the optical 
disk. 
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FIG. 2 
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FIG. 15 
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FIG. 1 6 
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FIG. 1 7 
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FIG. 1 9 
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FIG. 29 
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FIG. 31 
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FIG. 93 

Operation of conventional reproduction apparatus (compatibility) 

^-303a 



MADM disk of m streams 
is reproduced 



Stream switch instruction is input 



-303b 



-303c 



An identifier 
"Indicating existence of 2nd reproductioi 
~~ " information? 



303d 



No x 
(Non-seamless flag=0) 



Address jump to 1st reproduction 
information (DSI) for reproduction 



i Reproduction information i 
{(PCI) is invalid and unusable] 



1st reproduction information (DSI) 
includes data on stre ams 1 and 2 

1 ~ 



Reproduction on pointer information 
of streams 1 and 3 

i 



-303e 
-303f 



Stream 1 



Switching 

| Stream 3 | Reproduces only 1 and 3 
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FIG. 94 

C Operation of MADM reproduction apparatus) 



Reproduction of MADM diskV ^304a 



Yes 
ientifier 

_ Indicating high resolution 
„sub signal/30 recording area, or 2nd 
reproduction information 
identifier? 



304b 



Conventional disk 
No (Streams 1,2) 



Original 
identifier indicating 
2nd reproduction informatio 
~~ js valid? 

No 



, MADM disk % 
(Streams 1,2,3,4) 

304c 



304h 



L 



304d 



2nd reproduction information (PCI) 
is regarded as valid 
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/-304j 



2nd reproduction information (PCI) 
is regarded as invalid 



-304e 



Link information of streams 1,2,3 
and 4 is extracted from 2nd 
reproduction information (PCI) 



Address jump to first link information 
(DSI) for reproduction 



[Main stream of switchable stream"] 
lis detected from first link information i 
[(D^(jtre^mJ^3j_ ___ J 



I 



Link information on streams 1 and 
3 is obtained using first reproduction 
information (DSI) 
Reproduction mode of stream 1 is 
switched to reproduction mode 
of stream 3 



~3G4f 



304k 




Switching from stream 1— * stream 3: > 
A: Switched from the mode of jump 
reproduction of interleave unit using 
pointer address information of streams 1 
and 2 of second link information (PCI) 
B: Switched to the mode of jump 
reproduction of interleave unit using 
pointer address information of streams 3 
and 4 of second link information (PCI) 
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